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Dear Sir: 



CORRECTED APPEAL BRIEF 

Appellants have appealed to the Board of Patent Appeals and Interferences ("Board") 
from the decision of the Examiner mailed December 18, 2006, finally rejecting Claims 1-22. 
Appellants filed a Notice of Appeal and Pre-Appeal Brief Request for Review on March 8, 
2007, with authorization to charge the statutory fee of $500.00. Appellants file this Corrected 
Appeal Brief in response to the Notification of Non-compliance that was mailed June 6, 
2007. This Corrected Appeal Brief is also filed in response to a Panel Decision dated March 
28, 2007, which indicates that there is at least one issue for Appeal. 
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Real Party In Interest 

This Application is currently owned by Unified Graphics Systems Corporation (UGS 
Corp.) as indicated by: 

an assignment recorded on 01/22/2002 from inventors Jack C.H. Chung, Jia-Yi (NMI) 
Wang, and Chien-Tai (NMI) Wu to Electronic Data Systems Corporation, in the Assignment 
Records of the PTO at Reel 012529, Frame 0741 (6 pages); 

an assignment recorded on 06/28/2004 from Electronic Data Systems Corporation to 
Unified Graphics Systems PLM Solutions Incorporated, in the Assignment Records of the 
PTO at Reel 015354, Frame 0900 (6 pages); 

an assignment recorded on 06/28/2004 from Unified Graphics Systems PLM 
Solutions Incorporated to Unified Graphics Systems Corporation, in the Assignment Records 
of the PTO at Reel 014782, Frame 0440 (10 pages); and 

an assignment of security interest recorded on 06/28/2004 from Unified Graphics 
Systems Corporation to JPMorgan Chase Bank, as Administrative Agent, in the Assignment 
Records of the PTO at Reel 014782, Frame 0450 (9 pages). 
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Related Appeals and Interferences 

To the knowledge of Appellants' counsel, there are no known interferences or judicial 
proceedings that will directly affect or be directly affected by or have a bearing on the 
Board's decision regarding this Appeal. 
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Status of Claims 

Claims 1-22 are pending in this Application with Claims 1-22 being rejected pursuant 
to a Final Office Action mailed December 18, 2006 (the "Final Office Action"). All pending 
claims are shown in the Claims Appendix, attached hereto, along with an indication of the 
status of those claims. 

Claims 1-3, 5, 9, 11-14, 16, 20, and 22 are rejected under 35 U.S.C. § 102(b) as being 
anticipated by U.S. Patent No. 6,102,958 issued to Meystel et al ("Meystel"). Claims 4, 6-8, 
10, 15, 17-19 and 21 are rejected under 35 U.S.C. §103(a) as being unpatentable over 
Meystel, in view of U.S. Patent No. 6,826,541 issued to Johnston et al ("Johnston"). For the 
reasons discussed below, Appellants respectfully submit that these rejections are improper 
and should be reversed by the Board. Accordingly, Appellants presents Claims 1-22 for 
Appeal. 

All pending claims are shown in Appendix A, attached hereto, along with an 
indication of the status of those claims. A copy of Meystel is attached as Evidence Appendix 
1 and a copy of Johnston is attached as Evidence Appendix 2. 
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Status of Amendments 

All amendments submitted by Appellants have been entered by the Examiner. 
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Summary of Claimed Subject Matter 



Essentially, in accordance with one example embodiment of the present invention, an 
integrated decision support framework is provided, whereby different types of decision- 
drivers from numerous sources can be converted into a unified decision network including, 
for example, both mathematical and node-edge graph representations. A graph-theoretic 
algorithm may be applied to the large problem (unified decision network) to detect and 
separate strongly-connected components. The strongly-connected components represent sub- 
problems that must be solved simultaneously. A dependency propagation technique may be 
used to properly order the sub-problems so they can be processed and solved sequentially and 
correctly. Each strongly-connected component (small sub-problem) can be delegated to a 
suitable decision generator depending on the types of relations included in the component. 
For example, a numerical solution algorithm may be used to solve the ordered, numerical 
relations sub-problems, an algebraic solution algorithm may be used to solve the ordered, 
geometric relations sub-problems, and a logical inference engine (algorithm) may be used to 
solve the ordered, logical relations sub-problems. Solutions thus derived can be propagated 
to the next stage of the decision resolution process until a complete problem is solved. 
{Specification, page 8, lines 6-30). 

FIGURE 2 illustrates an example method 1 00 for integrated decision support that may 
be used to implement one example embodiment of the present invention. For example, 
method 1 00 may be a computer-executed software application used to implement an example 
integrated decision support framework application such as 1 6a or 1 6b in FIGURE 1 . At step 
102, all diverse inputs (e.g., decision-drivers) for a product development process are received. 
For example, at step 102, some or all of (but not necessarily limited to) the following diverse 
types of input information may be received with respect to a collaborative product 
development process: option selections; linear relations; dependencies; production rules; 
logical relations; inequality expressions; geometric constraints; etc. At step 104, the received 
inputs can be converted into a unified decision network that can include both node-edge 
graph representations and mathematical representations of the received input information. By 
compiling these conversions and representations into a unified decision network (e.g., a 
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unified set of inputs), all of the received inputs may be taken into account before an overall 
decision is derived. {Specification, page 10, line 20 through page 11, line 9). 

FIGURE 3 illustrates how certain of the received decision inputs can be converted 
into node-edge graph representations. 



As shown, the three-dimensional structure 200a can be represented as a node-edge graph 
200b. The geometric entities of structure 200a may be represented as nodes in graph 200b, 
and the constraints imposed on structure 200a may be represented as edges in graph 200b. 
For example, the geometric entities Point 1, Plane 1, Plane 2 and Plane 3 in structure 200a are 
represented as the nodes in graph 200b. The edges in graph 200b describe the constraints or 
limitations imposed on the structure 200a, or the relationships between the nodes. As 
illustrated by graph 200b, Point 1 is constrained to be located on Plane 1, Plane 2 and Plane 
3, while Plane 1, Plane 2 and Plane 3 are constrained to be perpendicular to each other. 
{Specification, page 11, lines 10-25). 

At step 1 04 (as mentioned earlier), certain of the received input decision-drivers can 
also be expressed as mathematical expressions (e.g., conditional equations, inequality 
equations, equality equations, difference equations, etc.). For example, a received input 
including an equality relation between the size of a particular pin and the size of the hole 
needed to accept the pin may be expressed mathematically as "Hole_Size = Pin_Size + 
5mm". Also, for example, a received input including an inequality relation as to the cost of a 



200a 




FIG. 3 
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part may be expressed mathematically as "Total_Cost < 1000 dollars". A received input 
including a conditional relation for a part may be expressed mathematically, for example, as: 
"if Loading_Capacity > X, use Roller_Bearing, else use Ball_Bearing". In other words, the 
geometric entities for such received inputs may be represented as variables, and the 
constraints and dimensions imposed may be represented as mathematical equations. 
(Specification, page 11, line 26 through page 12, line 12). 

At step 106, after the received inputs are converted into a unified decision network 
(e.g., decision inputs now expressed as one large problem including graph representations 
and mathematical representations), the large problem can be decomposed into a group of 
smaller sub-problems. For example, a graph-theoretic algorithm may be applied to the one 
large problem in order to decompose it into a group of smaller sub-problems. For the 
mathematical representations of the large problem, a graph-theoretic algorithm (e.g., See 
Serrano, D., and Gossard, D. C, "Combining Mathematical Models With Geometric Models 
In CAE Systems," Proc. ASME Computer in Eng. Conf., Chicago, IL, July 1986.) may be 
applied to match each mathematical equation with a unique variable to prevent over- 
constraining. After the equation-variable matching is completed, the dependency and 
coupling between all equations can be derived, which leads to the breakup of the total 
equation set into smaller groups. The smaller groups of equations can then be solved 
sequentially and efficiently using suitable computer-implemented solution techniques, for 
example, the Newton-Raphson computation method or the Modified Gram-Schmidt 
computation method. (Specification, page 12, line 13 through page 13, line 3). 

In order to decompose the graph representations of the large problem into a group of 
smaller sub-problems, the structure of the node-edge graph may be analyzed. An analysis of 
the graph's structure shows (e.g., see graph 200b) that certain of the nodes may be considered 
terminal nodes, because all of the edges incident upon them can be used to drive those nodes. 
In other words, the graph may be decomposed and thus simplified by removing terminal 
nodes from the graph. As such, a node and its connecting edges may be removed from a 
graph, if the total number of degrees of freedom of the edges is less than or equal to that of 
the node. For example, in graph 200b, node Point 1 is incident on three planes, which 
generally provides a stable solution. Consequently, for decomposition purposes, node Point 1 
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and all three incident edges can be removed from graph 200b. FIGURE 4 illustrates how 
graph 200b can be decomposed into a set of algebraically solvable components, by removing 
a set of terminal nodes (e.g., Point 1, Plane 1, Plane 3, Plane 2) from graph 200b. 
{Specification, page 13, line 14 through page 14, line 2). 




FIG. 4 

At step 108, as part of the large, unified problem decomposition process, certain 
algorithms (e.g., graph-matching algorithms, Tarjan's algorithm, tri-connectivity algorithms, 
etc.) may be applied to the algebraically solvable sub-problems in order to detect the 
strongly-connected components (e.g., coupling between the different equations). Notably, tri- 
connected graphs include exactly three paths between any pair of distinct vertices. 
Consequently, tri-connectivity algorithms may be suitable to use for ordering graph sub- 
problems, because most problems encountered in industry are not highly coupled (e.g., 2 or 3 
couples at the most). (Specification, page 14, lines 3-14). 

At step 110, once the decomposition process is completed and the set of smaller sub- 
problems has been identified, a dependency propagation technique may be used to place the 
sub-problems in a proper order so that they can be sequentially and correctly processed and 
solved. In general, dependency propagation is a relational technique that records the 
relationships between the dimensions or parameters of the sub-problems, and then maintains 
these relationships as the dimensions or parameters are changed. For example, using 
dependency propagation to order the algebraically solvable components (FIG. 4) of the graph 
200b shown in FIGURE 3, a solution sequence for graph 200b can be (maintaining the 
relationships or dependencies between components): Plane 2 -> Plane 3; Plane 3 -> Plane 1; 
and Plane 1 -> Point 1 . As a result of the decomposition process, an ordered list of small 
problems (e.g., 2 or 3 relations) is thus ready to be solved. Notably, for an overall decision in 
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a practical industry environment, there may be thousands of these groups of small problems 
(e.g., 2 or 3 simultaneous relations per group) that need to be solved. {Specification, page 14, 
line 15 through page 15, line 4). 

At step 112, each group of small problems can be solved sequentially and a group at a 
time. For example, a numerical solution algorithm (e.g., implemented in software) may be 
used to solve the purely numerical relations problems, an algebraic solution algorithm may be 
used to solve the purely geometric relations problems, and a logical inference algorithm may 
be used to solve the purely logical relations problems sequentially in accordance with the 
listed order. {Specification, page 15, lines 5-13). 

At step 114, once an attempt has been made to solve the entire, ordered list of sub- 
problems, any sub-problem that may not be solved (e.g., a conflict exists), if any, may be 
identified. At step 116, if any such sub-problem is identified, the input or decision-driver 
related to that sub-problem may be re-specified, and the present method can return to step 
104 to re-process that re-defined input. Otherwise, at step 120, an overall decision may be 
reported as complete. The integrated decision support method 100 may be re-iterated with 
new or re-specified inputs until a complete problem is deemed solved. {Specification, page 
15, lines 14-25). 

With regard to the independent claims currently under Appeal, Appellants provide the 
following concise explanation of the subject matter recited in the claim elements. For 
brevity, Appellants do not necessarily identify every portion of the Specification and 
drawings relevant to the recited claim elements. Additionally, this explanation should not be 
used to limit Appellants' claims but is intended to assist the Board in considering the Appeal 
of this Application. 
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For example, independent Claim 1 recites the following: 



A method for integrated decision support (e.g., Figure 2; 
Specification, page 10, line 20 through page 15, line 25), comprising the 
steps of: 

receiving a plurality of decision inputs (e.g., Figure 2, step 102; 
Specification, page 10, line 26 through page 11, line 2); 

converting a first plurality of said received decision inputs to a 
plurality of graph representations (e.g., Figure 2, step 104; Figure 3; 
Specification, page 11, lines 2-25); 

converting a second plurality of said received decision inputs to a 
plurality of mathematical representations (e.g., Figure 2, step 104; 
Specification, page 11, line 26 through page 12, line 12); 

decomposing said converted first plurality of said received 
decision inputs and said converted second plurality of said received 
decision inputs to a plurality of sub-problems (e.g., Figure 2, step 106; 
Figure 4; Specification, page 12, line 13 through page 14, line 2); 

detecting a plurality of strongly-connected components associated 
with said plurality of sub-problems, each of said plurality of strongly- 
connected components representing a connection between at least two of 
said plurality of sub-problems (e.g., Figure 2, step 108; Specification, page 
14, lines 3-14); and 

solving said plurality of sub-problems (e .g., Figure 2, step 112; 
Specification, page 15, lines 5-13). 



As another example, independent Claim 1 1 recites the following: 

Software for integrated decision support (e.g., Figure 1, reference 
numeral 16a; Specification, page 8, line 31 through page 10, line 19), the 
software being embodied in a computer-readable medium and when 
executed operable to: 

receive a plurality of decision inputs (e.g., Figure 2, step 102; 
Specification, page 10, line 26 through page 11, line 2); 

convert a first plurality of said received decision inputs to a 
plurality of graph representations (e.g., Figure 2, step 104; Figure 3; 
Specification, page 11, lines 2-25); 

convert a second plurality of said received decision inputs to a 
plurality of mathematical representations (e.g., Figure 2, step 104; 
Specification, page 11, line 26 through page 12, line 12); 

decompose said converted first plurality of said received decision 
inputs and said converted second plurality of said received decision inputs 
to a plurality of sub-problems (e.g., Figure 2, step 106; Figure 4; 
Specification, page 12, line 13 through page 14, line 2); 

detect a plurality of strongly-connected components associated 
with said plurality of sub-problems, each of said plurality of strongly- 
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connected components representing a connection between at least two of 
said plurality of sub-problems (e.g., Figure 2, step 108; Specification, page 
14, lines 3-14); and 

solve said plurality of sub-problems (e.g., Figure 2, step 112; 
Specification, page 15, lines 5-13). 

As another example, independent Claim 12 recites the following: 



A computer-implemented system for integrated decision support 
(e.g., Figure 1, reference numeral 10; Specification, page 8, line 31 
through page 10, line 19), comprising: 

a processor (e.g., Figure 1, reference numeral 14; Specification, 
page 8, line 31 through page 10, line 19); and 

a data storage device coupled to said processor (e.g., Figure 1, 
reference numeral 20; Specification, page 8, line 31 through page 10, line 
19), said processor operable to: 

receive a plurality of decision inputs (e.g., Figure 2, step 102; 
Specification, page 10, line 26 through page 11, line 2); 

convert a first plurality of said received decision inputs to a 
plurality of graph representations (e.g., Figure 2, step 104; Figure 3; 
Specification, page 11, lines 2-25); 

convert a second plurality of said received decision inputs to a 
plurality of mathematical representations (e.g., Figure 2, step 104; 
Specification, page 11, line 26 through page 12, line 12); 

decompose said converted first plurality of said received decision 
inputs and said converted second plurality of said received decision inputs 
to a plurality of sub-problems (e.g., Figure 2, step 106; Figure 4; 
Specification, page 12, line 13 through page 14, line 2); 

detect a plurality of strongly-connected components associated 
with said plurality of sub-problems, each of said plurality of strongly- 
connected components representing a connection between at least two of 
said plurality of sub-problems (e.g., Figure 2, step 108; Specification, page 
14, lines 3-14); and 

solve said plurality of sub-problems (e.g., Figure 2, step 112; 
Specification, page 15, lines 5-13). 

As another example, independent Claim 22 recites the following: 

A system for integrated decision support (e.g., Figure 1, reference 
numeral 10; Specification, page 8, line 31 through page 10, line 19), 
comprising: 

means for receiving a plurality of decision inputs (e.g., Figure 1, 
reference numeral 10; Figure 2, step 102; Specification, page 8, line 31 
through page 10, line 19; Specification, page 10, line 26 through page 11, 
line 2); 
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means for converting a first plurality of said received decision 
inputs to a plurality of graph representations (e.g., Figure 1, reference 
numeral 10; Figure 2, step 104; Figure 3; Specification, page 8, line 31 
through page 10, line 19; Specification, page 11, lines 2-25); 

means for converting a second plurality of said received decision 
inputs to a plurality of mathematical representations (e.g., Figure 1, 
reference numeral 10; Figure 2, step 104; Figure 3; Specification, page 8, 
line 31 through page 10, line 19; Specification, page 11, line 26 through 
page 12, line 12); 

means for decomposing said converted first plurality of said 
received decision inputs and said converted second plurality of said 
received decision inputs to a plurality of sub-problems (e.g., Figure 1, 
reference numeral 10; Figure 2, step 106; Figure 4; Specification, page 8, 
line 31 through page 10, line 19; Specification, page 12, line 13 through 
page 14, line 2); 

means for detecting a plurality of strongly-connected components 
associated with said plurality of sub-problems, each of said plurality of 
strongly-connected components representing a connection between at least 
two of said plurality of sub-problems (e.g., Figure 1, reference numeral 
10; Figure 2, step 108; Specification, page 8, line 31 through page 10, line 
19; Specification, page 14, lines 3-14); and 

means for solving said plurality of sub-problems (e.g., Figure 1, 
reference numeral 10; Figure 2, step 112; Specification, page 8, line 31 
through page 10, line 19; Specification, page 15, lines 5-13). 

In this Appeal Brief, Appellants have argued certain dependent claims separately. 
With regard to these dependent claims, Appellants provide the following concise explanation 
of the subject matter recited in the claim elements. For brevity, Appellants do not necessarily 
identify every portion of the Specification and drawings relevant to the recited claim 
elements. Additionally, this explanation should not be used to limit Appellants' claims but is 
intended to assist the Board in considering the Appeal of this Application. 



For example, dependent Claim 2 recites the following: 

performing dependency propagation for said plurality of sub-problems (e.g., 
Figure 2; Page 8, lines 16-19; Page 14, lines 15 through Page 15, line 4). 

Dependent Claim 13 recites certain similar features and operations. 

As another example, dependent Claim 3 recites the following: 

executing a graph-theoretic algorithm for a plurality of mathematical equations 
associated with said plurality of strongly-connected components to prevent over- 
constraining (e.g., Figure 2; Page 8, lines 12-14; Page 12, lines 13-27). 
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Dependent Claim 14 recites certain similar features and operations. 



As another example, dependent Claim 4 recites the following: 

decomposing said converted first plurality of said received decision inputs and 
said converted second plurality of said received decision inputs to a plurality of 
mathematical equations and algebraically solvable graph components (e.g., Figure 4; 
Page 13, line 30 through Page 14, line 2; Page 14, line 26 through Page 15, line 4). 

Dependent Claim 15 recites certain similar features and operations. 



As another example, dependent Claim 5 recites the following: 



detecting a plurality of dependency relations within said plurality of sub- 
problems (e.g., Figure 2; Page 12, line 27 through Page 13, line 3; Page 14, line 15 
through Page 15, line 4). 

Dependent Claim 16 recites certain similar features and operations. 



As another example, dependent Claim 6 recites the following: 



identifying a plurality of simultaneous equations within said plurality of sub- 
problems (e.g., Page 4, lines 17-21; Page 8, lines 12-16; Page 14, line 24 through Page 
15, line 4). 

Dependent Claim 17 recites certain similar features and operations. 



As another example, dependent Claim 7 recites the following: 



solving a plurality of numerical sub-problems and a plurality of algebraic sub- 
problems (e.g., Figure 4; Page 8, lines 19-30; Page 13, line 30 through Page 14, line 2; 
Page 14, line 26 through Page 15, line 4). 

Dependent Claim 18 recites certain similar features and operations. 
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As another example, dependent Claim 8 recites the following: 



solving a plurality of numerical relations sub-problems with a numerical 
solution algorithm; (e.g., Figure 2; Page 8, lines 19-30; Page 14, lines 5-13) 

solving a plurality of geometric relations sub-problems with an algebraic 
solution algorithm (e.g., Figure 2; Page 8, lines 19-30; Page 14, lines 5-13); and 

solving a plurality of logical relations sub-problems with a logical inference 
solution algorithm (e.g., Figure 2; Page 8, lines 19-30; Page 14, lines 5-13). 

Dependent Claim 19 recites certain similar features and operations. 



As another example, dependent Claim 10 recites the following: 



solving a plurality of simultaneous equations with a Newton-Raphson algorithm 
or Modified Gram-Schmidt algorithm (e.g., Figure 2; Page 12, line 27 through Page 13, 
line 3). 

Dependent Claim 21 recites certain similar features and operations. 
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Grounds of Rejection to be Reviewed on Appeal 

Are Claims 1-3, 5, 9, 11-14, 16, 20, and 22 anticipated under 35 U.S.C. § 102(b) by 
U.S. Patent No. 6,102,958 issued to Meystel et al. ("MeysteFy 

Are Claims 4, 6-8, 10, 15, 17-19, and 21 unpatentable under 35 U.S.C. § 103(a) over 
Meystel in view of U.S. Patent No. 6,826,541 issued to Johnston et al. ^Johnston")! 
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Arguments 

Claims 1-3, 5, 9, 11-14, 16, 20, and 22 are rejected under 35 U.S.C. § 102(b) as being 
anticipated by U.S. Patent No. 6,102,958 issued to Meystel et al ("Meystel"). Claims 4, 6-8, 10, 
15, 17-19 and 21 are rejected under 35 U.S.C. §103(a) as being unpatentable over Meystel, in 
view of U.S. Patent No. 6,826,541 issued to Johnston et al ("Johnston"). Copies of Meystel and 
Johnston are attached in the Evidence Appendix. For the reasons discussed below, Appellants 
respectfully submit that these rejections are improper and should be reversed by the Board. 

I. The Rejection of Appellants' Claims under 35 U.S.C. § 102 is Improper 

A. Standard 

"A claim is anticipated only if each and every element as set forth in the claim is 
found, either expressly or inherently described, in a single prior art reference." Verdegaal 
Bros. v. Union Oil Co. of California, 2 U.S.P.Q.2d 1051, 1053 (Fed. Cir. 1987); M.P.E.P. 
§ 2131. In addition, "[t]he identical invention must be shown in as complete detail as is 
contained in the . . . claims" and "[t]he elements must be arranged as required by the claim." 
Richardson v. Suzuki Motor Co., 9 U.S.P.Q.2d 1913, 1920 (Fed. Cir. 1989); In re Bond, 15 
U.S.P.Q.2d 1566 (Fed. Cir. 1990); M.P.E.P. § 2131 (emphasis added). 

B. The Meystel Reference 

Meystel relates to "a process control system that determines optimal trajectories (input 
controls) using multiresolutional analysis of acquired data. In contrast to conventional 
control systems, the present control system does not use a predetermined mathematical model 
or algorithm to define the process in terms of a plurality of variables. Rather, the present 
system acquires system data and stores the data in a multiresolutional data structure. A 
knowledge base is created which can be searched at varying levels of resolution for 
determining optimal process trajectories. The continual addition of data to the data structure 
allows for continual top-down refinement of the determined trajectories and bottom-up 
improvement and updating of the system representation." (Meystel, Abstract). 
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"The present invention comprises a multiresolutional decision support system 
(MDSS) for plant performance enhancement. MDSS implements selected features of 
multiresolutional control theory to assist in the process of making optimal, or cost 
minimizing, decisions for both process control and design. MDSS is able to integrate 
information from diverse sources or subsystems and, without using models or equations, to 
formulate plans or rules of system operation which provide the best performance according to 
a set of criteria of interest, subject to the constraints of available information. One of the main 
features of MDSS is an ability to generalize precise information (acquired data) into 
successively more abstract levels of resolution, which allows a significant reduction in the 
complexity of analysis of alternatives. Such analysis can, therefore, be performed via 
successive refinement of increasingly accurate projections within a more constrained 
envelope at each level of resolution. Once the multiresolutional structure of consecutively 
generalized data is constructed, a top-down "navigation" is possible which constitutes the 
core of the MDSS functioning." {Meystel, column 8, lines 29-50). 

"MDSS efficiently analyzes distributed system information obtained as a result of on- 
line data acquisition. Acquired data is organized in a hierarchy of scale and scope, permitting 
examination in a narrower envelope at each succeeding level of higher resolution. Each plan 
determined at a higher resolution is more detailed than at preceding (lower resolution) levels 
and is based on a more localized and precise examination of selected information. The 
hierarchical organization dramatically reduces the complexity of information storage and 
analysis. MDSS allows the use of a distributed modeling technique with information acquired 
and embedded into the model, to synthesize optimal strategies of operation." (Meystel, 
column 8, lines 51-63). 

"Generally, the system 100 comprises a preprocessing subsystem 102, a 
representation subsystem 1 04, a planning or search subsystem 1 06, an arbitration subsystem 
108, a prediction or optimization subsystem 110, and a stabilizing feedback subsystem 112. 
The plant or process 14 being controlled is monitored by a plurality of sensors, as previously 
discussed, which sensors provide data 16 for use by the system 100. The plant or process 14 
includes several levels of data acquisition for a general multicomponent system running 
several concurrently actuated loops. The levels may be derived from physical considerations, 
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such as dependence of one loop on a satisfactory operation of another loop. The operation of 
the control system 100 is discussed below." (Meystel, column 15, lines 1 1-24). 

"The plant or process 14 performance can be measured by a variety of yardsticks, 
including financial savings, the meeting of regulatory standards, maximization of the 
operational life of a plant, and minimization of the need for operator intervention (reliability). 
As long as the cost measures, however objective, are tangible and may be evaluated from 
measurements, they can be incorporated into the present control system 100, either separately 
or in a weighted combination. As opposed to prior art analytical approaches, there is no 
constraint on the simultaneous evaluation of cost by a variety of measures." (Meystel, 
column 15, lines 25-35). 

"The overall strategy of optimization and successive refinement employed in MDSS 
is contingent upon the creation of a multiresolutional representation. The key requirements of 
the system 100 are that it must contain a generalized representation of system capabilities at a 
resolution (level) that allows global optimization without violating computational restraints 
and that each level must contain a more dense (precise) representation than the previous 
level. If this is achieved, then search at each successive level of resolution generates a more 
precise solution of the optimization problem. If prior experiences are informationally rich, the 
process of optimization is based on such rich experiences, and if prior experiences are poor, 
interpolation and extrapolation may be required." (Meystel, column 15, lines 36-50). 

"A multiresolutional representation may be visualized as a hierarchical store of 
information, incorporating appropriately quantized descriptions of achievable system 
responses. The information is organized by precision into levels of increasingly detailed 
description. Algorithms for the incorporation of new information into the hierarchy are 
considered part of the system's knowledge. Thus, a finite set of information about the system 
100 is assembled, which, in association with search and retrieval algorithms, answers the 
same questions as the more familiar mathematical abstraction or model, viz, what is the effect 
on measurable or identifiable plant variables of a particular excitation. Learning is 
implemented by collecting and integrating experiences and by subsequent random testing in 
the intervals between experiences. Information about the same objects is represented at 
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several appropriate levels of resolution (nested, hierarchical, local decomposition is a 
complicated but apt description of this principle). The ability to analyze gross behavior, as 
well as local perturbations is also built in for efficient analysis of alternatives. The source of a 
model can be tested or carried out on any of an existing plant, an exiting dynamic model of 
more or less arbitrary complexity, or a custom-built model with elements that include rules, 
look-up tables, equations, and empirical data. Subjective and inconsistent, as well as 
traditional cost or penalty criteria are locally evaluated and incorporated into a model for 
future analysis. The overall strategy is thus one which places the burden of determining and 
achieving performance goals upon the control system, as opposed to a system designer. The 
present invention reinforces the feedback control component of a control system, using the 
byproduct of the planning subsystem 106 and the planning component (using learning 
algorithms and the feedback derived from system operation), the control system 100 is 
provided with the attributes of intelligence." (Meystel, column 15, line 51 through column 
16, line 17). 

"The major operational steps of the present invention are preprocessing and data 
analysis, multiresolutional model design, cost evaluation and process improvement. The first 
step, preprocessing and data analysis, provides an adequate description of the plant or process 
14 by constructing and validating a distributed multiresolutional provisional model of the 
plant or process 14. The multiresolutional model may be validated using a multi-valued graph 
representation, as described in more detail below. Cost evaluation may be performed using a 
sliding window to compute the costs of operation of the process in a tangible form. The 
sliding window permits the application of the model for process improvement which can then 
be measured in a consistent manner. The width of the sliding window is determined by the 
actual discretization of the available information and the required accuracy of results. The 
process improvement step represents the continual improvement of the process by applying 
search and optimization algorithms to the distributed model. Critical but previously unknown 
relationships of the process may be discovered during the preprocessing of information for 
the model." (Meystel, column 16, lines 18-39). 
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C. Claims 1, 9, 11, 12, 20, and 22 are patentable over Meystel 
Independent Claim 1 of the present application recites: 



A method for integrated decision support, comprising the steps of: 
receiving a plurality of decision inputs; 

converting a first plurality of said received decision inputs to a 
plurality of graph representations; 

converting a second plurality of said received decision inputs to a 
plurality of mathematical representations; 

decomposing said converted first plurality of said received 
decision inputs and said converted second plurality of said received 
decision inputs to a plurality of sub-problems; 

detecting a plurality of strongly-connected components associated 
with said plurality of sub-problems, each of said plurality of strongly- 
connected components representing a connection between at least two of 
said plurality of sub-problems; and 

solving said plurality of sub-problems. 



Appellants respectfully submit that Meystel does not disclose, either expressly or inherently, 
each and every element of Appellants' Claim 1. 



For example, Meystel does not disclose, teach, or suggest "converting a second plurality 
of said received decision inputs to a plurality of mathematical representations," as recited in 
Claim 1 . Rather, Meystel is concerned with regulating plant performance using a multi-valued 
graph representation, without generating mathematical representations. In the Final Office 
Action, the Examiner identifies Column 10, lines 9-21 of Meystel as disclosing Appellants' step 
of "converting a second plurality of said received decision inputs to a plurality of mathematical 
representations." Relevant portions of Meystel disclose that "[a] first organizational subsystem 
20 acquires all inputs based information, such as the data 16, and organized such information 
for use by a modeling subsystem 22." (Column 9, lines 36-39). "The modeling subsystem 22 
determines functional relationships of the organized data, which are searched by a behavior 
generation subsystem 24." (Column 9, lines 39-41). Thus, Meystel merely discloses the 
organization of data within the data structure for improved searching. The portion of the 
reference cited by the Examiner merely clarifies that an "associative fusion of data module 32 
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forms a statement of rules from the data stored and organized." (Column 10, lines 8-10). "The 
rules differ in the degree of belief which is assigned based on the repetitiveness of the particular 
experiences (statistical) or trustworthiness of the particular source of information (expert)." 
(Column 10, lines 10-13). "The associative fusion of data module 32 comprises means for 
extraction of goal-independent data from the stored goal-dependent "experiences" in the form 
of generalized rules, or components of an automata transition function and state-output 
functions." (Column 10, lines 13-18). Thus, the cited portion of Meystel merely discloses the 
extraction of data from the data structure based on generalized statistical or source-based rules. 
Even if these statistical or source-based rules are used to extract data from the data structure of 
Meystel, there is no disclosure in Meystel of "converting a second plurality of said received 
decision inputs to a plurality of mathematical representations," as recited in Claim 1 . 

In fact, several portions of Meystel specifically state that mathematical representations 
are not used. For example, in the Abstract, Meystel discloses that "the system does not use a 
predetermined mathematical model or algorithm." As another example, Meystel states, "In 
contrast to prior art control systems, the present invention does not use a predetermined 
mathematical model or algorithm which defines the process in terms of a plurality of 
variables." (Column 3, lines 2-5). "Rather, the present invention acquires system data and 
stores the data in a multiresolutional data structure." (Column 3, lines 5-6). In the Final Office 
Action, the Examiner counters: 

Meystel et al does not state that mathematical representations are not used. 
Rather Meystel et al simply states that it does not use a predetermined 
mathematical model or algorithm, but instead a fluid provisional data 
structure (column 3, lines 3-12) and that it eliminates the stage of 
mathematical abstraction and parameter identification (column 21, lines 59- 
63). As such, neither cited portion precludes Meystel et al from teaching 
Applicant's invention. 

(Final Office Action, page 8). Appellants disagree. Meystel actually discloses that "[t]he 
present invention eliminates the stage of mathematical abstraction and parameter identification 
and instead, uses collected measurements (the data 16) to form a distributed multiresolutional 
knowledge representation which operated upon by search algorithms." (Column 21, lines 59- 
63). The use of "search and retrieval algorithms" to extract data from a data set, as identified 
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by the Examiner, is not analogous to "converting a second plurality of said received decision 
inputs to a plurality of mathematical representations," as recited in Claim 1. This fact is 
further emphasized by the touted advantage within Meystel that the multiresolutional decision 
support system "is able to integrate information from diverse sources or subsystems and, with 
out using models or equations, to formulate plans or rules of system operation which provide 
the best performance according to a set of criteria of interest, subject to the constraints of 
available information." (Column 8, lines 35-40, emphasis added). Accordingly, Meystel does 
not disclose, teach, or suggest "converting a second plurality of said received decision inputs to 
a plurality of mathematical representations," as recited in Claim 1 . 

As another example of the deficiencies of Meystel, Appellants submit that Meystel does 
not disclose, teach, or suggest "decomposing said converted first plurality of said received 
decision inputs and said converted second plurality of said received decision inputs to a 
plurality of sub-problems," as recited in Claim 1. The Final Office Action asserts Column 9, 
lines 37-40 of Meystel discloses the recited claim elements. (Final Office Action, page 3). 
Specifically, the Final Office Action alleges that "the organizational subsystem 20 organizes 
information for use by modeling system 22." (Final Office Action, page 3). Appellants agree 
that the cited portion of Meystel states that "[a] first organizational subsystem 20 acquires all 
input based information, such as the data 16, and organizes such information for use by a 
modeling subsystem." (Column 9, lines 37-40). However, organizing information is not 
analogous to Appellants' step of decomposing converted inputs to sub-problems . In fact, 
conspicuously absent from the Final Office Action's allegation is any mention of sub-problems. 
Appellants submit that this omission is not coincidental since, as described above, Meystel does 
not use sub-problems or mathematical representations. At best, Meystel is a decision processor 
that simply integrates data into a data structure for searching. There is no disclosure in Meystel 
of "decomposing said converted first plurality of said received decision inputs and said 
converted second plurality of said received decision inputs to a plurality of sub-problems," as 
recited in Claim 1 . 

For at least these reasons, Appellants respectfully submit that the rejection of 
independent Claim 1 and its dependent claims (including Claim 9) is improper and should be 
reversed by the Board. 
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The Examiner also relies on Meystel to reject independent Claims 11, 12, and 22. 
Appellants respectfully submit that Meystel does not disclose, teach, or suggest each and 
every element of Appellants' independent Claims 11, 12, and 22. For example, Claim 11 
recites "software being embodied in a computer-readable medium and when executed 
operable to . . . convert a second plurality of said received decision inputs to a plurality of 
mathematical representations." Claim 1 1 also recites the software operable to "decompose 
said converted first plurality of said received decision inputs and said converted second 
plurality of said received decision inputs to a plurality of sub-problems." As another 
example, Claim 12 recites a processor operable to "convert a second plurality of said received 
decision inputs to a plurality of mathematical representations." Claim 12 also recites that the 
processor is operable to "decompose said converted first plurality of said received decision 
inputs and said converted second plurality of said received decision inputs to a plurality of 
sub-problems." Claim 22 recites "means for converting a second plurality of said received 
decision inputs to a plurality of mathematical representations." Claim 22 also recites "means 
for decomposing said converted first plurality of said received decision inputs and said 
converted second plurality of said received decision inputs to a plurality of sub-problems." 
Thus, for reasons analogous to those discussed above with regard to Claim 1, Appellants 
respectfully submit that Meystel does not disclose, teach, or suggest each and every element 
set forth in Appellants' independent Claims 11, 12, and 22. 

For at least these reasons, Appellants respectfully submit that the rejections of 
independent Claims 11, 12, and 22 and their respective dependent claims (including Claim 20 
that depends on Claim 12) are improper and should be reversed by the Board. 

D. Claims 2 and 13 are patentable over Meystel 

Claims 2 and 13 depend upon independent Claims 1 and 12, respectively, which 
Appellants have shown above to be allowable. Accordingly, Claims 2 and 13 are not 
anticipated by Meystel at least because of this dependency. 
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Additionally, dependent Claims 2 and 13 recite elements that further distinguish the 
art. As an example, Claim 2 recites "performing dependency propagation for said plurality of 
sub-problems." Claim 13 recites certain analogous features and operations. In the Final 
Office Action, the Examiner identifies Column 10, lines 40-46 of Meystel as disclosing 
Appellants' recited claim elements. The cited portion merely states, however: 



The resolutional structure development module 34 comprises means fro 
developing a multiresolutional data (knowledge) structure based upon the 
"associative clusters", which can transform the provisional relational 
model into a multilevel hierarchical relational structure with any required 
number of levels of resolution, including embedded local dynamics of the 
plant or process 14. 

(Meystel, column 10, lines 40-46). Although in quotations, the term "associative clusters" is 
not defined by Meystel. As guidance, however, Meystel provides: 

The associative fusion of data module 32 forms a statement of rules from 
the data stored and organized by the experience organizer module 30. The 
rules differ in the degree of belief which is assigned based upon 
repetitiveness of the particular experiences (statistical) or trustworthiness 
of the particular source of information (expert). The associative fusion of 
data module 32 comprises means for extraction of goal-independent data 
from the stored goal-dependent "experiences", in the form of generalized 
rules, or components of an automata transition function and state- 
output functions. The extraction means may comprise any standard 
algorithm and/or procedure for inverting experimental causalities into the 
statements of rules. Preferably, more sophisticated procedures are applied 
to the organized data, linked with algorithms and procedures of fusing the 
experiences into "associative clusters". Such clusters form a function 
oriented, goal-independent provisional model of the plant or process 14. 

(Column 10, lines 8-24, emphasis added). Thus, Meystel merely discloses the organization of 
data within a data structure based on generalized rules or components of an automated 
transition function and state-output functions. Meystel does not disclose, teach, or suggest the 
step of "performing dependency propagation for said plurality of sub-problems," as recited 
in Claims 2 and 13. 



For at least these reasons, Appellants respectfully submit that the rejections of 
dependent Claims 2 and 13 are improper and should be reversed by the Board. 



DAL01:961 085.1 



ATTORNEY DOCKET NO. 
075635.0124 (05-01-016) 



26 



PATENT APPLICATION 
Serial No. 10/055,098 



E. Claims 3 and 14 are patentable over Meystel 

Claims 3 and 14 depend upon independent Claims 1 and 12, respectively, which 
Appellants have shown above to be allowable. Accordingly, Claims 3 and 14 are not 
anticipated by Meystel at least because of this dependency. 

Additionally, dependent Claims 3 and 14 recite elements that further distinguish the 
art. As an example, Claim 3 recites "executing a graph-theoretic algorithm for a plurality of 
mathematical equations associated with said plurality of strongly-connected components to 
prevent over-constraining." Claim 14 recites certain analogous features and operations. In 
the Final Office Action, the Examiner identifies Column 16, lines 42-45 of Meystel as 
disclosing Appellants' recited claim elements. The cited portion merely states, however: 

The preprocessing subsystem 102 is provided for preprocessing raw plant 
information or data 1 6 using hierarchical clustering algorithms in order to 
synthesize a multiresolutional knowledge base. 

{Meystel, column 16, lines 42-45). Although discussing "hierarchical clustering algorithms," 
Meystel provides no indication that such hierarchical clustering algorithms are "graph-theoretic 
algorithms of mathematical equations," as recited in Claims 3 and 14. 

Furthermore, Appellants have shown above that Meystel specifically states that 
mathematical representations are not used. For example, in the Abstract, Meystel discloses that 
"the system does not use a predetermined mathematical model or algorithm." As another 
example, Meystel states, "In contrast to prior art control systems, the present invention does not 
use a predetermined mathematical model or algorithm which defines the process in terms of a 
plurality of variables." (Column 3, lines 2-5). "Rather, the present invention acquires system 
data and stores the data in a multiresolutional data structure." (Column 3, lines 5-6). Touting 
an advantage of the multiresolutional decision support system disclosed in Meystel, Meystel 
stipulates that the system "is able to integrate information from diverse sources or subsystems 
and, with out using models or equations, to formulate plans or rules of system operation 
which provide the best performance according to a set of criteria of interest, subject to the 
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constraints of available information." (Column 8, lines 35-40, emphasis added). As such, 
Meystel does not disclose, teach, or suggest "a plurality of mathematical equations" and 
certainly does not disclose, teach, or suggest "executing a graph-theoretic algorithm for a 
plurality of mathematical equations associated with said plurality of strongly-connected 
components to prevent over-constraining," as recited in Claims 1 . 

For at least these reasons, Appellants respectfully submit that the rejections of 
dependent Claims 3 and 14 are improper and should be reversed by the Board. 

F. Claims 5 and 16 are patentable over Meystel 

Claims 5 and 16 depend upon independent Claims 1 and 12, respectively, which 
Appellants have shown above to be allowable. Accordingly, Claims 5 and 16 are not 
anticipated by Meystel at least because of this dependency. 

Additionally, dependent Claims 5 and 16 recite elements that further distinguish the 
art. As an example, Claim 5 recites "detecting a plurality of dependency relations within said 
plurality of sub-problems." Claim 16 recites certain analogous features and operations. In 
the Final Office Action, the Examiner identifies Column 9, lines 40-42 of Meystel as 
disclosing Appellants' recited claim elements. The cited portion merely states, however: 

The modeling subsystem 22 determines functional relationships of the 
organized data, which are searched by a behavior generation subsystem 
24. 

{Meystel, column 9, lines 40-42). Although discussing "functional relationships," Meystel 
provides no indication that such functional relationships are analogous to Appellants' recited 
"dependency relations." Furthermore, Appellants have shown above that Meystel does not 
disclose, teach, or suggest "sub-problems" or that the data in the data structure is organized into 
"sub-problems." Again, Appellants submit that this omission is not coincidental since, as 
described above, Meystel does not use sub-problems or mathematical representations. At best, 
Meystel is a decision processor that simply integrates data into a data structure for searching. 
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There is no disclosure in Meystel of "detecting a plurality of dependency relations within said 
plurality of sub-problems/' as recited in Claims 5 and 16. 

For at least these reasons, Appellants respectfully submit that the rejections of 
dependent Claims 5 and 1 6 are improper and should be reversed by the Board. 

II. The Rejections of Appellant's Claims under 35 ILS.C. § 103 are Improper 

A. Standard 

The Examiner rejects Claims 4, 6-8 5 10, 15, 17-19 and 21 are rejected under 35 U.S.C. 
§ 103(a), which states: 

A patent may not be obtained though the invention is not identically 
disclosed or described as set forth in section 102 of this title, if the 
differences between the subject matter sought to be patented and the prior 
art are such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in the 
art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

The question raised under 35 U.S.C. § 103 is whether the prior art taken as a whole 
would suggest the claimed invention taken as a whole to one of ordinary skill in the art at the 
time of the invention. See 35 U.S.C. § 103(a). Accordingly, even if all elements of a claim 
are disclosed in various prior art references, which is certainly not the case here as discussed 
below, the claimed invention taken as a whole cannot be said to be obvious without some 
reason given in the prior art why one of ordinary skill in the art at the time of the invention 
would have been prompted to modify the teachings of a reference or combine the teachings 
of multiple references to arrive at the claimed invention. 

The M.P.E.P. sets forth the strict legal standard for establishing a prima facie case of 
obviousness based on modification or combination of prior art references. "To establish a 
prima facie case of obviousness, three basic criteria must be met. First, there must be some 
suggestion or motivation, either in the references themselves or in the knowledge generally 
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available to one of ordinary skill in the art, to modify the reference or combine reference 
teachings. Second, there must be a reasonable expectation of success. Finally, the prior art 
reference (or references where combined) must teach or suggest all the claim limitations." 
M.P.E.P. § 2142, 2143. The teaching, suggestion or motivation for the modification or 
combination and the reasonable expectation of success must both be found in the prior art and 
cannot be based on an Appellant's disclosure. See Id. (citations omitted). "Obviousness can 
only be established by combining or modifying the teachings of the prior art to produce the 
claimed invention where there is some teaching, suggestion, or motivation to do so found 
either explicitly or implicitly in the references themselves or in the knowledge generally 
available to one of ordinary skill in the art" at the time of the invention. M.P.E.P. § 2143.01. 
Even the fact that references can be modified or combined does not render the resultant 
modification or combination obvious unless the prior art teaches or suggests the desirability 
of the modification or combination. See Id. (citations omitted). Moreover, "To establish 
prima facie obviousness of a claimed invention, all the claim limitations must be taught or 
suggested by the prior art. All words in a claim must be considered in judging the 
patentability of that claim against the prior art." M.P.E.P. § 2143.03 (citations omitted). 

The governing Federal Circuit case law makes this strict legal standard even more 
clear. 1 According to the Federal Circuit, "a showing of a suggestion, teaching, or motivation 
to combine or modify prior art references is an essential component of an obviousness 
holding." In re Sang-Su Lee, 277 F.3d 1338, 1343, 61 U.S.P.Q.2d 1430, 1433 (Fed. Cir. 
2002) (quoting Brown & Williamson Tobacco Corp. v. Philip Morris Inc., 229 F.3d 1120, 
1124-25, 56 U.S.P.Q.2d 1456, 1459 (Fed. Cir. 2000)). "Evidence of a suggestion, teaching, 
or motivation . . . may flow from the prior art references themselves, the knowledge of one of 
ordinary skill in the art, or, in some cases, the nature of the problem to be solved." In re 
Dembiczak, 175 F.3d 994, 999, 50 U.S.P.Q.2d 1614, 1617 (Fed. Cir. 1999). However, the 
"range of sources available . . . does not diminish the requirement for actual evidence." Id. 
Although a prior art device "may be capable of being modified to run the way the apparatus 
is claimed, there must be a suggestion or motivation in the reference to do so." In re Mills, 
916 F.2d at 682, 16 U.S.P.Q.2d at 1432. See also In re Rouffet, 149 F.3d 1350, 1357, 47 

1 Note M.P.E.P. 2145 X.C. ("The Federal Circuit has produced a number of decisions overturning obviousness 
rejections due to a lack of suggestion in the prior art of the desirability of combining references."). 
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U.S.P.Q.2d 1453, 1457-58 (Fed. Cir. 1998) (holding a prima facie case of obviousness not 
made where the combination of the references taught every element of the claimed invention 
but did not provide a motivation to combine); In Re Jones, 958 F.2d 347, 351, 21 U.S.P.Q.2d 
1941, 1944 (Fed. Cir. 1992) ("Conspicuously missing from this record is any evidence, other 
than the PTO's speculation (if that can be called evidence) that one of ordinary skill in the 
herbicidal art would have been motivated to make the modification of the prior art salts 
necessary to arrive at" the claimed invention.). Even a determination that it would have been 
obvious to one of ordinary skill in the art at the time of the invention to try the proposed 
modification or combination is not sufficient to establish a prima facie case of obviousness. 
See In re Fine, 837 F.2d 1071, 1075, 5 U.S.P.Q.2d 1596, 1599 (Fed. Cir. 1988). 

In addition, the M.P.E.P. and the Federal Circuit repeatedly warn against using an 
Appellants' disclosure as a blueprint to reconstruct the claimed invention. For example, the 
M.P.E.P. states, "The tendency to resort to 'hindsight' based upon applicant's disclosure is 
often difficult to avoid due to the very nature of the examination process. However, 
impermissible hindsight must be avoided and the legal conclusion must be reached on the 
basis of the facts gleaned from the prior art." M.P.E.P. § 2142. The governing Federal 
Circuit cases are equally clear. "A critical step in analyzing the patentability of claims 
pursuant to [35 U.S.C. § 103] is casting the mind back to the time of invention, to consider 
the thinking of one of ordinary skill in the art, guided only by the prior art references and the 
then-accepted wisdom in the field. . . . Close adherence to this methodology is especially 
important in cases where the very ease with which the invention can be understood may 
prompt one 'to fall victim to the insidious effect of a hindsight syndrome wherein that which 
only the invention taught is used against its teacher.'" In re Kotzab, 217 F.3d 1365, 1369, 55 
U.S.P.Q.2d 1313, 1316 (Fed. Cir. 2000) (citations omitted). In In re Kotzab, the Federal 
Circuit noted that to prevent the use of hindsight based on the invention to defeat 
patentability of the invention, the court requires the Examiner to show a motivation to 
combine the references that create the case of obviousness. See id. See also, e.g., Grain 
Processing Corp. v. American Maize-Products, 840 F.2d 902, 907, 5 U.S.P.Q.2d 1788, 1792 
(Fed. Cir. 1988). Similarly, in In re Dembiczak, the Federal Circuit reversed a finding of 
obviousness by the Board, explaining that the required evidence of such a teaching, 
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suggestion, or motivation is essential to avoid impermissible hindsight reconstruction of an 
applicant's invention: 

Our case law makes clear that the best defense against the subtle but powerful 
attraction of hind-sight obviousness analysis is rigorous application of the 
requirement for a showing of the teaching or motivation to combine prior art 
references. Combining prior art references without evidence of such a 
suggestion, teaching, or motivation simply takes the inventor's disclosure as a 
blueprint for piecing together the prior art to defeat patentability — the essence 
of hindsight. 

175 F.3d at 999, 50 U.S.P.Q.2d at 1617 (emphasis added) (citations omitted). 

B. The Johnston Reference 

Johnston relates to methods, systems, and computer program products for "facilitating 
user choices among complex alternatives [utilizing] conjoint analysis to simplify choices to 
be made by the user. A selector tool presents a user with a first and second series of choices 
relating to attributes of products or services available to the user. A utilities calculation 
engine calculates the relative utility of each of the products or services to the user and 
presents output to the user, which indicates the relative utility of each of the products or 
services. The user can then select the product or service that has the highest utility value for 
the user based on the calculated relative utility values." {Johnston, Abstract). 

C. Claims 4, 6-8, 15, and 17-19 

1. Claims 4, 6-8, 15, and 17-19 are Allowable over the Proposed 
Meystel-Johnston Combination 

First, Appellants submit that the proposed Meystel-Johnston combination fails to 
teach, suggest, or disclose the combination of elements recited in Appellants' claims. 

Claims 4 and 6-8 depend upon independent Claim 1, which Appellants have shown 
above to be allowable. Claims 15 and 17-19 depend upon independent Claim 12, which 
Appellants have shown above to be allowable. Accordingly, Claims 4, 6-8, 15, and 17-19 
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are not obvious over the proposed Meystel-Johnston combination at least because of their 
dependencies. 

Additionally, dependent Claims 4, 6-8, 15, and 17-19 recite elements that further 
distinguish the art. For example, the proposed Meystel-Johnston combination does not 
disclose, teach, or suggest the following claim elements: 

• "decomposing said converted first plurality of said received decision inputs and 
said second plurality of said received decision inputs to a plurality of 
mathematical equations and algebraically solvable graph components," as 
recited in Claim 4 (and similarly recited in Claim 15; 

• "identifying a plurality of simultaneous equations within said plurality of sub- 
problems," as recited in Claim 6 (and similarly recited in Claim 17; 

• "solving a plurality of numerical sub-problems and a plurality of algebraic sub- 
problems," as recited in Claim 7 (and similarly recited in Claim 1 8); and 

• "solving a plurality of geometric relations sub-problems with an algebraic 
solution algorithm," as recited in Claim 8 (and similarly recited in Claim 19). 

With respect to each of these claims the Examiner acknowledges in the Final Office Action that 
Meystel fails to disclose the recited claim elements. {Final Office Action, pages 5-7). Instead, 
as a basis for rejecting each of the above claim elements, the Examiner makes the following 
statement: 

Johnston et al discloses a method for facilitating choices among complex 
alternatives, wherein a statistical algorithm implemented involves 
calculation of regression coefficient (column 12, lines 38-42), including 
matrix analysis (column 14). 

(Final Office Action, pages 5-7). The Examiner does not identify, however, how the disclosure 
of a statistical algorithm involving regression coefficients and matrix analysis is the same as 
performing the diverse operations recited in Appellants' Claims 4, 6-8, 15, and 17-19. 

In fact, Johnston merely relates to "[a] utilities calculation engine calculates the relative 
utility of each of the products or services to the user [available to the user] and presents output 
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to the user, which indicates the relative utility of each of the products or services." {Johnston, 
Abstract). The portion of Johnston cited by the Examiner discusses a "statistical algorithm 
implemented by utilities calculation engine 202" that involves the "calculation of "regression" 
coefficients for inserting into an equation representing the quantitative values chosen by a 
individual to measure his or her judgment of the importance of the difference between some 
best value of each important "attribute" and some worst value of the "attribute" . . ." {Johnston, 
Column 12, lines 38-42). With regard to matrix analysis, Johnston merely discloses that the 
matrix analysis renders "final set of data to be analyzed." (Column 16, line 1). Specifically, 
"each row (of both the Y vector and the X matrix) represents a single response the "user" has 
given, the actual response being recorded in the Y vector." (Column 16, lines 23-25). "From 
this type data set, the B regression coefficients are calculated . . . Each B coefficient is paired 
with and thus modifies one "attribute." (Column 16, lines 33-41). Thus, Johnston merely 
discloses using matrix analysis to calculate utilities for attributes identified by a user. 

However, there is no disclosure in Johnston of "algebraically solvable graph 
components" or of "decomposing . . . decision inputs to a plurality of mathematical equations 
and algebraically solvable graph components," as recited in Appellants' Claims 4 and 15. 
Additionally, there is no disclosure in Johnston that the calculation of regression coefficients 
through matrix analysis is analogous to "identifying a plurality of simultaneous equations 
within said plurality of sub-problems," as recited in Appellants' claims 6 and 17, "solving a 
plurality of numerical sub-problems and a plurality of algebraic sub-problems," as recited in 
Claims 7 and 18, or "solving a plurality of geometric relations sub-problems with an algebraic 
solution algorithm," as recited in Claims 8 and 19. These claim elements are absent from the 
disclosures of Meystel and Johnston. 

For at least these reasons, Appellants respectfully submit that the rejections of 
dependent Claims 4, 6-8, 15, and 17-19 are improper and should be reversed by the Board. 
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2. One of Ordinary Skill in the Art Would not have been Motivated to 
Make the Proposed Meystel- Johnston Combination 

Additionally, Appellants submit that the Examiner has not demonstrated the requisite 
teaching, suggestion, or motivation in Meystel, Johnston, or the knowledge generally available to 
those of ordinary skill in the art at the time of the invention to modify or combine Meystel and 
Johnston in the manner the Examiner proposes. The rejections are improper and should be 
reversed for at least this additional reason. 

As discussed above in Section II. A of this Appeal Brief, the question raised under 35 
U.S.C. § 103 is whether the prior art taken as a whole would suggest the claimed invention taken 
as a whole to one of ordinary skill in the art at the time of the invention. Accordingly, even if all 
elements of a claim are disclosed in various prior art references, which is certainly not the case 
here as discussed above, the claimed invention taken as a whole cannot be said to be obvious 
without some reason given in the prior art why one of ordinary skill at the time of the invention 
would have been prompted to modify the teachings of a reference or combine the teachings of 
multiple references to arrive at the claimed invention. In the Final Office Action, the Examiner 
relies upon Meystel as the primary reference and upon Johnston as the secondary reference. 
{Final Office Action, pages 5-7). Appellants respectfully submit, however, that the Examiner has 
merely pieced together disjointed portions of references, with the benefit of hindsight using 
Appellants' claims as a blueprint, in an attempt to reconstruct Appellants' claims. 

According to the Examiner, "[b]oth Meystel and Johnston are concerned with 
improving decision making." {Final Office Action, pages 5-7). It is the Examiner's 
contention that "it would have been obvious to one of ordinary skill in the art at the time the 
invention was made" to modify Meystel "as seen in Johnston, as tool for making difficult 
decisions less complex (see Johnston, column 2, lines 21-26), thus making Meystel more 
effective and robust." {Final Office Action, pages 5-7). It appears that the Examiner has 
merely proposed alleged advantages of combining Meystel with Johnston (advantages which 
Appellants do not admit could even be achieved by combining these references in the manner 
the Examiner proposes). The Examiner has not pointed to any portions of the cited 
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references, however, that would teach, suggest, or motivate one of ordinary skill in the art at 
the time of invention to incorporate the system "for facilitating user choices among complex 
alternatives [utilizing] conjoint analysis to simplify choices to be made by the user" disclosed 
in Johnston with the multiresolutional decision support system disclosed in Meystel. In other 
words, the Examiner has not provided an explanation as to: (1) why it would have been 
obvious to one of ordinary skill in the art at the time of Appellants' invention {without using 
Appellants 9 claims as a guide) to modify the particular techniques disclosed in Meystel with 
the cited disclosure in Johnston; (2) how one of ordinary skill in the art at the time of 
Appellants' invention would have actually done so; and (3) how doing so would purportedly 
meet the limitations of Appellants' claims. 

The mere possibility that a modification might improve Meystel, as the Examiner 
asserts, by making Meystel more "effective and robust" does not even remotely provide the 
required teaching, suggestion, or motivation to modify the teachings of Meystel Indeed, if it 
were sufficient for Examiners to merely point to a purported advantage of one reference and 
conclude that it would have been obvious to combine of modify that reference with other 
references simply based on that advantage (which, as should be evident from the case law 
discussed above, it certainly is not), then virtually any two or more references would be 
combinable just based on the fact the one reference states an advantage of its system. Of 
course, as the Federal Circuit has made clear and as discussed above, that is not the law. 

Furthermore, Appellants respectfully submit that one of ordinary skill in the art would 
not have been motivated to make the proposed Meystel-Johnston combination. Even if both 
Meystel and Johnston relate to "improved decision making" as posited by the Examiner, 
Meystel specifically teaches away from the use of mathematical representations. For 
example, Meystel actually discloses that "[t]he present invention eliminates the stage of 
mathematical abstraction and parameter identification and instead, uses collected 
measurements (the data 1 6) to form a distributed multiresolutional knowledge representation 
which operated upon by search algorithms." (Column 21, lines 59-63). As a provided 
advantage, Meystel stipulates that the multiresolutional decision support system "is able to 
integrate information from diverse sources or subsystems and, with out using models or 
equations, to formulate plans or rules of system operation which provide the best 
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performance according to a set of criteria of interest, subject to the constraints of available 
information." (Column 8, lines 35-40, emphasis added). Accordingly, it would not have 
been obvious to one of ordinary skill in the art at the time of Appellants' invention to modify 
the multiresolutional decision support system disclosed in Meystel to include the calculation 
of regression coefficients and matrix analysis disclosed in Johnston. 

For at least these reasons, Appellants respectfully submit that the proposed Meystel- 
Johnston combination is improper with respect to Appellants' Claims 4, 6-8, 15, and 17-19. 
Accordingly, the rejection of Appellants' claims over the proposed Meystel- Johnston 
combination should be reversed by the Board. 

D. Claims 10 and 21 are Allowable over the Proposed Meystel- Johnston 
Combination 

For the reasons discussed below, Appellants submit that the proposed Meystel- 
Johnston combination fails to teach, suggest, or disclose the combination of elements recited 
in Appellants' claims. 

Claims 10 and 21 depend upon independent Claims 1 and 12, respectively, which 
Appellants have shown above to be allowable. Accordingly, Claims 10 and 21 are not 
obvious over the proposed Meystel- Johnston combination at least because of their respective 
dependencies. 

Additionally, dependent Claims 10 and 21 recite elements that further distinguish the 
art. As an example, Claim 10 recites "solving a plurality of simultaneous equations with a 
Newton-Raphson algorithm or Modified Gram-Schmidt algorithm." Claim 21 recites certain 
analogous features and operations. In the Final Office Action, the Examiner acknowledges that 
Meystel fails to disclose the recited claim elements. However, the Examiner fails to identify 
any other reference that discloses the recited claim elements and that could be properly 
combined with Meystel. Instead, the Examiner states, "the Newton-Raphson algorithm and 
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Modified Gram-Schmidt algorithms are old and well known in the art, therefore it would have 
been obvious to one having ordinary skill in the art at the time the invention was made to 
include Newton-Raphson algorithm or Modified Gram-Schmidt algorithm in Meystel, as an 
efficient means of solving simultaneous equations, thus making Meystel more efficient and 
robust." {Final Office Action, page 7). 

However, the M.P.E.P. sets forth the strict legal standard for establishing a prima 
facie case of obviousness based on modification of prior art references. The standard for 
such a modification is discussed above in Section II. A. Briefly, however, Appellants note 
that "[o]bviousness can only be established by combining or modifying the teachings of the 
prior art to produce the claimed invention where there is some teaching, suggestion, or 
motivation to do so found either explicitly or implicitly in the references themselves or in the 
knowledge generally available to one of ordinary skill in the art" at the time of the 
invention." M.P.E.P. § 2143.01. Even the fact that references can be modified does not 
render the resultant modification or combination obvious unless the prior art teaches or 
suggests the desirability of the modification or combination. See Id. (citations omitted). 
According to the Federal Circuit, "a showing of a suggestion, teaching, or motivation to 
combine or modify prior art references is an essential component of an obviousness holding." 
In re Sang-Su Lee, 277 F.3d 1338, 1343, 61 U.S.P.Q.2d 1430, 1433 (Fed. Cir. 2002) (quoting 
Brown & Williamson Tobacco Corp. v. Philip Morris Inc., 229 F.3d 1120, 1124-25, 56 
U.S.P.Q.2d 1456, 1459 (Fed. Cir. 2000)). Even a determination that it would have been 
obvious to one of ordinary skill in the art at the time of the invention to try the proposed 
modification or combination is not sufficient to establish a prima facie case of obviousness. 
See In re Fine, 837 F.2d 1071, 1075, 5 U.S.P.Q.2d 1596, 1599 (Fed. Cir. 1988). 

In the Final Office Action, the Examiner concludes that "the Newton-Raphson 
algorithm and Modified Gram-Schmidt algorithms are old and well known in the art" and that 
"it would have been obvious to one having ordinary skill in the art at the time the invention 
was made to include Newton-Raphson algorithm or Modified Gram-Schmidt algorithm in 
Meystel" {Final Office Action, page 7). As motivation for the proposed modification, the 
Examiner speculates that such a modification would make Meystel "more efficient and 
robust." {Final Office Action, page 7). However, the Examiner has not cited any evidence of 
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a teaching, suggestion, or motivation to modify the teachings of MeysteL Instead, the 
Examiner has merely stated that the teachings of one reference would improve the teachings 
of another reference. The Examiner's summary conclusion amounts to mere speculation and 
does not provide the suggestion or motivation necessary to make the proposed combination. 
The mere possibility that a modification might improve Meystel, as the Examiner asserts, 
does not even remotely provide the required teaching, suggestion, or motivation to modify 
the teachings of MeysteL Rather, this statement represents the subjective belief of the 
Examiner, does not point to any known authority, and therefore is not based on objective 
evidence of record. 

It appears that the Examiner has merely proposed alleged advantages of modifying 
Meystel (advantages which Appellants do not admit could even be achieved by modifying 
Meystel in the manner the Examiner proposes). It is not sufficient to propose a modification 
to Meystel based on the mere possibility that the modification might improve MeysteL In 
other words, the advantages provided by the Examiner do not provide an explanation as to: 
(1) why it would have been obvious to one of ordinary skill in the art at the time of 
Applicants' invention {without using Applicants' claims as a guide) to modify the particular 
techniques disclosed in Masumoto with the cited disclosures in Ng and Hsieh; (2) how one of 
ordinary skill in the art at the time of Applicants' invention would have actually done so; and 
(3) how doing so would purportedly meet the limitations of the claims. Indeed, if it were 
sufficient for Examiners to merely point to a purported advantage of one reference and 
conclude that it would have been obvious to combine of modify that reference with other 
references simply based on that advantage (which, as should be evident from the case law 
discussed above, it certainly is not), then virtually any two or more references would be 
combinable just based on the fact the one reference states an advantage of its system. The 
Federal Circuit has made clear that this is not the law. 

For at least these reasons, Appellants respectfully submit that the proposed 
modification of Meystel is improper with respect to Appellants' Claims 10 and 21. 
Accordingly, the rejection of Appellants' claims over the proposed MeysteUJohnston 
combination should be reversed by the Board. 
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CONCLUSION 



Appellants have demonstrated that the present invention, as claimed, is clearly 
distinguishable over the prior art cited by the Examiner. Therefore, Appellants respectfully 
request the Board to reverse the final rejections and instruct the Examiner to issue a Notice of 
Allowance with respect to all pending claims. 

Appellants believe that no fees are due; however, the Commissioner is hereby 
authorized to charge any fees or credit any overpayment to Deposit Account No. 02-0384 of 
Baker Botts, L.L.P. 



Respectfully submitted, 



BAKER BOTTS L.L.P. 
Attorneys for Appellant: 




Reg. No. 52,038 
(214) 953-6809 



Date: June 12, 2007 



Correspondence Address: 
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IN THE CLAIMS: 

1. (Previously Presented) A method for integrated decision support, comprising 
the steps of: 

receiving a plurality of decision inputs; 

converting a first plurality of said received decision inputs to a plurality of graph 
representations; 

converting a second plurality of said received decision inputs to a plurality of 
mathematical representations; 

decomposing said converted first plurality of said received decision inputs and said 
converted second plurality of said received decision inputs to a plurality of sub-problems; 

detecting a plurality of strongly-connected components associated with said plurality 
of sub-problems, each of said plurality of strongly-connected components representing a 
connection between at least two of said plurality of sub-problems; and 

solving said plurality of sub-problems. 

2. (Original) The method of Claim 1, wherein the decomposing step further 
comprises the steps of: 

performing dependency propagation for said plurality of sub-problems; and 
placing said plurality of sub-problems in at least one predefined order for solution. 

3. (Original) The method of Claim 1, wherein the detecting step comprises 
executing a graph-theoretic algorithm for a plurality of mathematical equations associated 
with said plurality of strongly-connected components to prevent over-constraining. 

4. (Original) The method of Claim 1, wherein the decomposing step comprises 
decomposing said converted first plurality of said received decision inputs and said converted 
second plurality of said received decision inputs to a plurality of mathematical equations and 
algebraically solvable graph components. 

5. (Previously Presented) The method of Claim 1, wherein the detecting step 
comprises detecting a plurality of dependency relations within said plurality of sub-problems. 



DAL01:96I085.1 



ATTORNEY DOCKET NO. 
075635.0124 (05-01-016) 



42 



PATENT APPLICATION 
Serial No. 10/055,098 



6. (Previously Presented) The method of Claim 1, wherein the detecting step 
comprises identifying a plurality of simultaneous equations within said plurality of sub- 
problems. 

7. (Original) The method of Claim 1 ? wherein the solving step comprises solving 
a plurality of numerical sub-problems and a plurality of algebraic sub-problems. 

8. (Original) The method of Claim 1, wherein said solving step comprises: 
solving a plurality of numerical relations sub-problems with a numerical solution 

algorithm; 

solving a plurality of geometric relations sub-problems with an algebraic solution 
algorithm; and 

solving a plurality of logical relations sub-problems with a logical inference solution 
algorithm. 

9. (Original) The method of Claim 1, wherein said plurality of decision inputs 
comprises at least one of: 

a plurality of option selection parameters; 

a plurality of equality relation parameters; 

a plurality of dependency parameters; 

a plurality of production rule parameters; 

a plurality of logical relation parameters; 

a plurality of inequality expression parameters; and 

a plurality of geometric constraint parameters. 

10. (Original) The method of Claim 1, wherein the solving step comprises solving 
a plurality of simultaneous equations with a Newton-Raphson algorithm or Modified Gram- 
Schmidt algorithm. 
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1 1 . (Previously Presented) Software for integrated decision support, the software 
being embodied in a computer-readable medium and when executed operable to: 

receive a plurality of decision inputs; 

convert a first plurality of said received decision inputs to a plurality of graph 
representations; 

convert a second plurality of said received decision inputs to a plurality of 
mathematical representations; 

decompose said converted first plurality of said received decision inputs and said 
converted second plurality of said received decision inputs to a plurality of sub-problems; 

detect a plurality of strongly-connected components associated with said plurality of 
sub-problems, each of said plurality of strongly-connected components representing a 
connection between at least two of said plurality of sub-problems; and 

solve said plurality of sub-problems. 

12. (Previously Presented) A computer-implemented system for integrated 
decision support, comprising: 

a processor; and 

a data storage device coupled to said processor, said processor operable to: 
receive a plurality of decision inputs; 

convert a first plurality of said received decision inputs to a plurality of graph 
representations; 

convert a second plurality of said received decision inputs to a plurality of 
mathematical representations; 

decompose said converted first plurality of said received decision inputs and said 
converted second plurality of said received decision inputs to a plurality of sub-problems; 

detect a plurality of strongly-connected components associated with said plurality of 
sub-problems, each of said plurality of strongly-connected components representing a 
connection between at least two of said plurality of sub-problems; and 

solve said plurality of sub-problems. 
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13. (Original) The system of Claim 12 5 wherein said processor is further operable 

to: 

perform dependency propagation for said plurality of sub-problems; and 

place said plurality of sub-problems in at least one predefined order for solution. 

14. (Original) The system of Claim 12, wherein said processor is further operable 
to execute a graph-theoretic algorithm for a plurality of mathematical equations associated 
with said plurality of strongly-connected components to prevent over-constraining. 

15. (Original) The system of Claim 12, wherein said processor is further operable 
to decompose said converted first plurality of said received decision inputs and said 
converted second plurality of said received decision inputs to a plurality of mathematical 
equations and algebraically solvable graph components. 

16. (Previously Presented) The system of Claim 12, wherein said processor is 
further operable to detect a plurality of dependency relations within said plurality of sub- 
problems. 

17. (Previously Presented) The system of Claim 12, wherein said processor is 
further operable to identify a plurality of simultaneous equations within said plurality of sub- 
problems. 

18. (Original) The system of Claim 12, wherein said processor is further operable 
to solve a plurality of numerical sub-problems and a plurality of algebraic sub-problems. 
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19. (Original) The system of Claim 12 5 wherein said processor is further operable 

to: 

solve a plurality of numerical relations sub-problems with a numerical solution 
algorithm; 

solve a plurality of geometric relations sub-problems with an algebraic solution 
algorithm; and 

solve a plurality of logical relations sub-problems with a logical inference solution 
algorithm. 

20. (Original) The system of Claim 12, wherein said plurality of decision inputs 
comprises at least one of: 

a plurality of option selection parameters; 

a plurality of equality relation parameters; 

a plurality of dependency parameters; 

a plurality of production rule parameters; 

a plurality of logical relation parameters; 

a plurality of inequality expression parameters; and 

a plurality of geometric constraint parameters. 

21. (Original) The system of Claim 12, wherein said processor is further operable 
to solve a plurality of simultaneous equations with a Newton-Raphson algorithm or Modified 
Gram-Schmidt algorithm. 
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22. (Previously Presented) A system for integrated decision support, comprising: 
means for receiving a plurality of decision inputs; 

means for converting a first plurality of said received decision inputs to a plurality of 
graph representations; 

means for converting a second plurality of said received decision inputs to a plurality 
of mathematical representations; 

means for decomposing said converted first plurality of said received decision inputs 
and said converted second plurality of said received decision inputs to a plurality of sub- 
problems; 

means for detecting a plurality of strongly-connected components associated with said 
plurality of sub-problems, each of said plurality of strongly-connected components 
representing a connection between at least two of said plurality of sub-problems; and 

means for solving said plurality of sub-problems. 
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[57] 



ABSTRACT 



A process control system determines optimal trajectories 
(input controls) using multiresolutional analysis of acquired 
data. In contrast to conventional control systems, the present 
control system does not use a predetermined mathematical 
model or algorithm to define the process in terms of a 
plurality of variables. Rather, the present system acquires 
system data and stores the data in a multiresolutional data 
structure. A knowledge base is created which can be 
searched at varying levels of resolution for determining 
optimal process trajectories. The continual addition of data 
to the data structure allows for continual top-down refine- 
ment of the determined trajectories and bottom-up improve- 
ment and updating of the system representation. 

5 Claims, 10 Drawing Sheets 
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MULTIRESOLUTIONAL DECISION 
SUPPORT SYSTEM 

BACKGROUND OF THE INVENTION 

The present invention relates to a system for multireso- 
lutional analysis of a complex system which cannot be 
adequately described with a mathematical model, and more 
particularly, to a method of multiresolutional analysis for 
optimizing the performance of an industrial facility, system 
and/or device which do not have an adequate model of 
representation. 

Human beings accomplish tasks by developing an orga- 
nized hierarchical structuring of information which "lumps" 
information at various levels of "resolution" (granularity, 
and/or scale). The information is then retrieved and 
employed at the appropriate resolution level. Information 
collected at a more general, or overview level is generally 
considered to be less precise, but more easily retained and 
retrieved. Such data is said to be low resolution level. 
Information collected at a detailed level is typically more 
precise, but is more difficult to retain and retrieve because of 
its abundance. Also it increases the complexity of compu- 
tation to a prohibitively high level. Such detailed informa- 
tion is generally termed high resolution level data. The 
complexity of computations at this level can be bounded by 
reducing the scope of the represented space of interest. 
When an individual acts on a task, the normal process is to 
constrain detailed action (higher resolution activity) based 
on general information (lower resolution data). Aprocess of 
selecting "good" versus "bad" data is employed to make 
decisions. 

Simulation and modeling systems use mathematical mod- 
els to fully describe systems or activities. The difference 
between the human approach and a computer-simulated 
approach is that the human mind does not rely on such 
mathematical models. The concept and application of dif- 
ferent resolution levels to automation and control systems is 
normally referred to as "supervisory control" and has been 
used in limited applications where the lower resolution 
system is only one or two levels above the higher resolution 
system. One such example is a unit load control system in 
a power plant. In such a system, the required megawatt 
(MW) output demand is defined at an overview level for the 
system. The demand value is then used in constraining 
functions to control subsystems (e.g., fuel/air, feed water, 
turbine valves) such that the megawatt demand is met. The 
operation of a power generating station highlights the semi- 
otic relationships of dependent and independent process 
variables at multiple, discrete levels of resolution. 

Generally, planning and control systems include a speci- 
fied goal according to some cost or other criterion. The 
classical approach to designing a control system generally 
comprises three stages: (1) develop or identify a model of 
the process or operation to be controlled, (2) validate the 
model using a known range of operating conditions, and (3) 
select optimal input values to achieve a desired system 
behavior. The first stage, development of a model, involves 
the selection of an appropriate mathematical structure for 
purposes of identification. The mathematical structure rep- 
resents a class of models which may be used to reproduce 
the input-output relationship of the system to be controlled. 
The semiotic character of the relationships in this case is 
taken care of by the symbol grounding procedures which 
employ on-line or pretabulated operations of interpretation. 
The mathematical structure is associated with a set of 
parameters, 0, so that the class of models may be repre- 
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sented in symbolic form as M(0). The identification prob- 
lem involves determining the parameter set such that the 
difference between an observed and predicted input-output 
behavior of the target system is minimized across the class 

5 of models. The second, validation stage may be performed 
concurrently with identification. The role of the validation 
stage is to verify the fidelity of the model across the expected 
range of operating conditions for the target system. In a 
system with an analytical model, validation is of deep 

10 concern because, in reality, the models are valid only for a 
limited time period, and in large complex systems, the 
limited time period is very small. The final stage is behavior 
generation, where having synthesized an adequate math- 
ematical model, the selection of optimal input-output behav- 

15 ior is attempted using one of several existing analytical 
techniques. The latter are usually associated with well- 
known techniques (such as dynamic programming and/or 
maximum principle) however all of them dwell upon search 
algorithms and are very costly computationally. In order to 

20 provide for the input-output behavior, input-output maps are 
computed and a second set of maps is generated for error 
compensation. When this approach is applied on-line, it is 
called control; when this approach is applied off-line, it is 
called planning. The latter is used to compute feedback 

25 control strings so that the on-line control (feedback 
compensation) can be done only to compensate for devia- 
tions from a feed-forward generated planned trajectory. 

In the classical approach, several implicit assumptions are 
made in order to simplify the required analysis. The most 

30 common and significant of the assumptions is that the class 
of models may be chosen from a set of smooth differential 
equations of the type: 

>>(0+«i/" ~ 1 \t)+a 2 y i "- 2 \t)+. . . +a^r)=M"~ 1) (0+M ( "~ 2) (0+- • • 

35 

for which the parameter set could be written as 0=^, 
a 2 , . . . , a„, bj, b 2 , . . . , b n ). A more general formulation of 
the class of mathematical structures might be closer to 

40 

*(0«M0+B"(0+v(0+N(w) 

where the A, B, and C matrices are coefficients of terms 
45 linear in state and input, V and W are noise terms, and N and 
M are non-linear components of the model. Further, gener- 
ality could be obtained by including partial derivatives in the 
formulation. 

The use of a class of candidate models which is capable 

50 of representing stochastic and non-linear dynamics which 
contribute significantly to system behavior in many settings, 
raises the complexity of behavior generation and optimiza- 
tion strategies. The difficulties grow substantially when both 
input-output pairs, as well as the parameter set are subject to 

55 disturbances. The problem becomes very difficult to solve 
when the system demonstrates distributed character. Exist- 
ing analytical techniques are not suited to mathematical 
models in this form. Consequently, superior identification 
techniques are of little value unless methods of behavior 

60 generation and optimization are utilized which can deter- 
mine useful strategies for this class of models. The classical 
approach is especially difficult to apply when trying to 
control a large complex system. Mathematical models for 
such systems are not well known and often are erroneous, so 

65 that the results of computations are fuzzy. 

The present invention is directed to a process control 
system which determines optimal trajectories (input 



6,102,958 



controls) using multiresolutional analysis of acquired data. 
In contrast to prior art control systems, the present invention 
does not use a predetermined mathematical model or algo- 
rithm which defines the process in terms of a plurality of 
variables. Rather, the present invention acquires system data 
and stores the data in a multiresolutional data structure. A 
knowledge base is thus created, which is searched at varying 
levels of resolution for determining optimal process trajec- 
tories. This base can be called "a model" in a very general 
sense. It is rather a fluid "provisional data structure" which 
is created and recreated on demand, to support the decision 
making process. The continual addition of data to the data 
structure allows for continual refinement of the determined 
trajectories. 

SUMMARY OF THE INVENTION 

Briefly stated, the present invention comprises a multi- 
resolutional decision support system for determining output 
trajectories for a predetermined output behavior of a plant or 
a process and for generating control signals for achieving the 
predetermined output behavior. The system comprises: 
means for acquiring data related to at least one process 

variable of the plant or process; 
means for organizing the acquired data into goal inde- 
pendent units and fusing the units into associative 
clusters of information; 
means for storing the associative clusters of information 

in a multiresolutional data storage structure; 
means for searching the multiresolutional storage struc- 
ture at successively more abstract levels of resolution in 
a bottom-up processing, or less and less abstract levels 
of resolution in a top-down processing, both utilized to 
determine a trajectory for achieving the predetermined 
output behavior; and 
means for translating the search results into control sig- 
nals for causing the plant or process to achieve the 
predetermined output behavior. 
In a second embodiment, a multiresolutional system for 
determining optimal trajectories of a process having a plu- 
rality of operational variables and cost functions is disclosed 
in which the system comprises: 

means for acquiring data relating to at least one of the 

operational variables; 
means for organizing the operational variables into a 

representative hierarchy; 
a multiresolutional data storage structure for storing the 
acquired data according to the representative hierarchy; 
means for embedding local dynamics of the process into 
at least one level of resolution of the data stored in the 
data storage structure; and 
means for synthesizing optimal trajectories of process 
operation using a search applied to the multiresolu- 
tional representation. 
In yet another embodiment, a multiresolutional decision 
support system for monitoring and controlling a plant or 
process and for determining optimal trajectories of operation 
for achieving a predefined operational behavior of the plant 
or process, the plant or process including a plurality of 
operational variables and cost constraints is disclosed in 
which the system comprises: 

a plurality of sensors for monitoring and acquiring data 
from a plurality of subsystems of the plant or process, 
the data relating to at least one of the operational 
variables; 

a memory device for storing the acquired data; 
means for organizing the operational variables into groups 
of goal-independent input-output rules; 
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a data structure for storing the acquired data in a multi- 
resolutional representation in accordance with the rules 
such that local dynamics of the plant or process are 
embedded in the data structure; 
5 processor means for recursive algorithmic multiresolu- 
tional search of the data stored in the data structure at 
varying levels of resolution and generating an optimal 
trajectory of operation of the plant or process for 
achieving the predefined operational behavior; and 
io control signal generation means for generating at least one 
control signal for controlling the operation of the plant 
or process according to the optimal trajectory in order 
to achieve the predefined operational behavior. 
A further embodiment of the present invention comprises, 
15 in a power plant, a planning and control system for deter- 
mining output trajectories of a predefined output behavior 
and input control commands for achieving the predefined 
output behavior, the system comprising: 

means for acquiring data related to at least one process 
20 variable of the power plant; 

means for organizing the acquired data and generating at 

least one state input-output string therefrom; 
means for fusing the acquired data into associative 
clusters, the clusters forming a function oriented, goal- 
independent provisional model of the power plant; 
means for generating a multiresolutional data structure 
based upon the associative data clusters for transform- 
ing the provisional model into at least one level of 
resolution incorporating embedded local dynamics of 
the power plant; 
means for searching the multiresolutional data structure at 
varying levels of resolution to determine an optimal 
trajectory of operation for achieving the predefined 
output behavior; and 
means for generating control signals for controlling at 
least one operational variable of the power plant such 
that the power plant operates according to the optimal 
trajectory. 

In yet another embodiment, the present invention com- 
prises a multiresolutional control system for plants and 
processes having a plurality of operational variables, 
constraints, and cost-functions, the control system for deter- 
mining trajectories and corresponding input control signals 
for achieving a predefined output behavior, the system 
comprising: 

(a) means for acquiring and organizing information 
related to at least one of the variables in the form of 
time-tagged quadruplets "state before-action-state 
after-value" strings; 

(b) means for extraction of goal-independent data from 
the goal-dependent strings in the form of generalized 
rules; 

(c) fusing components of the rules into associative clus- 
ters which form a function oriented goal-independent 
provisional model of the system, wherein multiple 
goal-independent and time-independent rules are clus- 
tered into more general rule statements, thereby pro- 
ducing a hierarchical system for storage and retrieval of 
rules; 

(d) means for developing a multiresolutional data struc- 
ture based upon the associative clusters which trans- 
forms the provisional relational model of the system 
into a multilevel hierarchical relational structure; 

(e) means for bottom-up formation of resolutional clusters 
which provide for further development of the provi- 
sional model of the system; 



50 



6,102,958 



10 



(f) means for top-down focusing of attention upon a 
subset of data within the provisional model and devel- 
oping envelopes of attention at least one level of 
resolution; 

(g) means for matching the predefined output behavior to 
the provisional model of the system for at least one 
level of resolution; 

(h) means for adjusting the constraints of the predefined 
operational behavior; 

(I) means for adjusting the cost function of the system to 
the model of at least one level of resolution with at least 
one envelope of attention; 
(j) means for searching within at least one envelope of 
attention for an optimal trajectory for achieving the 
predefined output behavior, wherein the process of 
searching is repeated consecutively at one or more 
levels of resolution with narrowing the search envelope 
and consecutive refinement of the results; and 
(k) means for generating system control signals at least at 
one level of resolution (otherwise, organized in a 
multiresolutional structure of control signals) related to 
the optimal trajectory for achieving the predefined 
system behavior. 
The present invention further is a method of determining 
output trajectories for a predetermined output behavior of a 
plant or a process and for generating control signals for 
achieving the predetermined output behavior, the method 
comprising the steps of: 

(a) acquiring data related to at least one process variable 
of the plant or process; 

(b) organizing the acquired data into goal independent 
units and fusing the units into associated clusters of 
information, and recursively organizing the associated 
clusters of information into a new set of associated 
clusters of lower resolution until a lowest level of 
resolution is achieved; 

(c) storing the associated clusters of information in a 
multiresolutional data storage structure; 

(d) searching the multiresolutional storage structure at 
successively higher levels of resolution to determine a 
trajectory for achieving the predetermined output 
behavior and propagating the search results succes- 
sively at the lower levels of resolution; and 

(e) translating the search results into control signals for 
causing the plant or process to achieve the predeter- 
mined output behavior. 

In another embodiment, the present invention is a method 
of determining optimal trajectories of a process having a 
plurality of operational variables and cost functions, the 
method comprising the steps of: 

(a) acquiring data relating to at least one of the operational 
variables; 

(b) organizing the operational variables into a represen- 55 
tative multiresolutional hierarchy; 

(c) storing the acquired data according to the representa- 
tive multiresolutional hierarchy in a multiresolutional 
data storage structure; 

(d) embedding local dynamics of the process into at least 60 
one level of resolution of the data stored in the data 
storage structure; and 

(e) synthesizing optimal trajectories of process operation 
using a search applied to the multiresolutional repre- 
sentation at successively higher levels of resolution 65 
with subsequent propagation of the search results to 
successively lower levels of resolution. 
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In yet another embodiment, the present invention is a 
method of monitoring and controlling a plant or process and 
of determining optimal trajectories of operation for achiev- 
ing a predefined operational behavior of the plant or process, 
the plant or process including a plurality of operational 
variables and cost constraints, the method comprising the 
steps of: 

(a) monitoring and acquiring data using a plurality of 
sensors, from a plurality of subsystems of the plant or 
process, the data relating to at least one of the opera- 
tional variables; 

(b) storing the acquired data in a memory device; 

(c) organizing the operational variables into groups of 
goal-independent input-output rules; 

(d) storing the acquired data in a data structure in a 
multiresolutional representation in accordance with the 
rules such that local dynamics of the plant or process 
are embedded in the data structure; 

(e) recursively searching the data stored in the data 
structure at varying levels of resolution and synthesiz- 
ing an optimal trajectory of operation of the plant or 
process for achieving the predefined operational behav- 
ior; and 

(f) generating at least one control signal for controlling 
the operation of the plant or process according to the 
optimal trajectory in order to achieve the predefined 
operational behavior. 

The present invention is further a method for determining 
output trajectories of a predefined output behavior and input 
control commands for achieving the predefined output 
behavior, in a power plant. The method comprises the steps 
of: 

(a) acquiring data related to at least one process variable 
of the power plant; 

(b) organizing the acquired data and generating a I least 
one state input-output string therefrom; 

(c) fusing the strings into associative clusters, the clusters 
forming a function oriented, goal-independent provi- 
sional model of the power plant; 

(d) generating a multiresolutional data structure based 
upon the associative data clusters for transforming the 
provisional model into at least one level of resolution 
incorporating embedded local dynamics of the power 
plant; 

(e) recursively searching the multiresolutional data struc- 
ture at varying levels of resolution to determine an 
optimal trajectory of operation for achieving the pre- 
defined output behavior; and 

(f) generating control signals for controlling at least one 
operational variable of the power plant such that the 
power plant operates according to the optimal trajec- 
tory. 

The present invention is also a method for plants and 
processes having a plurality of operational variables, 
constraints, and cost-functions, for determining trajectories 
and corresponding input control signals for achieving a 
predefined output behavior, the method comprising the steps 
of: 

(a) acquiring and organizing information related to at least 
one of the variables in the form of time-tagged qua- 
druplets "state befo re-action -state after-value" strings; 

(b) extracting goal-independent data from the goal- 
dependent strings in the form of generalized rules; 

(c) fusing components of the rules into associative clus- 
ters which form a function oriented goal-independent 
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provisional model of the system, wherein multiple FIGS, 7A-7C are graphic illustrations of a three dimen- 

goal-independent and time-independent rules are clus- sional state space at varying levels of resolution; 

tered into more general rule statements, thereby pro- FIGS. 8A-8B are graphic illustrations of search results 

ducing a hierarchical system for storage and retrieval of for an optimal operating trajectory of the state space of 

mles ; 5 FIGS. 7A and 7C, respectively; 

(d) developing a multiresolutional data structure based FIGS. 9A-9B are two-dimensional graphic illustrations of 
upon the associative clusters by using a recursive FIGS. 8A-8B (power against pressure and temperature, 
computational process which transforms the provi- respectively); and 

sional relational model of the system into a multilevel F IG. 10 is a graphic illustration of heat against power, 

hierarchical relational structure; 10 

(e) bottom-up recursive formation of resolution al clusters DETAILED DESCRIPTION OF PREFERRED 
within the multiresolutional data structure, which pro- EMBODIMENTS 

vides for further development of the provisional model list of desirable properties of an intelligent system 

of the system; includes the ability to "dynamically navigate" through an 

(f) top-down recursive focusing of attention upon a subset unstructured and partially unknown environment (processed 
of data within the provisional model and developing state space) using a knowledge base and planning, to make 
envelopes of attention at least one level of resolution; predictions or form hypotheses, and to demonstrate an 

(g) matching the predefined output behavior to the pro- ability to learn. According to the present invention, it is 
visional model of the system for at least one level of 20 possible to describe a dynamic system without using a 
resolution; conventional dynamic model, but rather by a properly orga- 

(h) adjusting the constraints of the predefined operational n ! zed ^ ow kdge base of P ri °r experiences which serve as a 
behavior; virtual, provisional model. A recursive algorithmic process 



(I) adjusting the cost function of the system to the model , ( , , , , , . , , r 

... t , . 1 r AA /• more detailed analysis, is applied al each level of precision 

with at least one envelope of attention; 25 . . / r 

1 to derive trajectories or paths at a predefined final precision, 

(j) searching within at least one envelope of attention for The trajectory derivation is done in a manner which restricts 

an optimal trajectory for achieving the predefined out- the quantity of data required at each iteration, even as the 

put behavior, wherein the process of searching is working precision increases by several orders of magnitude, 

repeated consecutively at one or more levels of reso- ^ m ^ a mu it ire so national deci- 

lution with narrowing the search envelope and con- sioQ s (MDSS) for ^ formance 

secu hve refinement of the results, wherein the search enhancement . MDSS implements selected features of mul- 

results are consecutively propagated from the bottom tiresolutional rontro i the t0 ^ in the ocess of 

up to the lower levels of resolution; and maldng optimal> Qr ^ minimizingj decision ; for both 

(k) generating system control signals related to the opti- 35 process control and design. MDSS is able to integrate 

mal trajectory for achieving the predefined system information from diverse sources or subsystems and, with- 

behavior. out using models or equations, to formulate plans or rules of 

BRIEF DESCRIPTION OF THE DRAWINGS SySta ?. ° P f rati ° n , wh f ich . pr0vid f e . lhe besl P erforman f 

according to a set oi criteria oi interest, subject to the 

The foregoing summary, as well as the following detailed 40 constraints of available information. One of the main fea- 

descriplion of a preferred embodiment of the invention, will tures of MDSS is an ability to generalize precise information 

be better understood when read in conjunction with the (acquired data) into successively more abstract levels of 

appended drawings. For the purpose of illustrating the resolution, which allows a significant reduction in the com- 

invenlion, there is shown in the drawings an embodiment plexity of analysis of alternatives. Such analysis can, 

which is presently preferred. However, it should be under- 45 therefore, be performed via successive refinement of 

stood that the invention is not limited to the precise arrange- increasingly accurate projections within a more constrained 

ment and instrumentalities disclosed. In the drawings: envelope at each level of resolution. Once the multiresolu- 

FIG. 1 is a schematic architectural block diagram of a tional structure of consecutively generalized data is 

control system in accordance with the present invention; constructed, a lop-down "navigation" is possible which 

FIG. 2 is a schematic block diagram of a computer based 50 constitutes the core of the MDSS functioning, 

control system in accordance with the present invention; MDSS efficiently analyzes distributed system information 

FIG. 3 is a schematic block diagram of the software obtained as a result of on-fine data acquisition. Acquired 

architecture of the control system in accordance with FIG. 2; data * organized in a hierarchy of scale and scope, permit- 

FIG. 4 is a schematic block diagram of a power generation |ing examination in a narrower envelope at each succeeding 

55 level 01 higher resolution. Each plan determined at a higher 



of planning, followed by the selection of a smaller space for 



company which supplies power to a regional power grid; 
FIG. 5 is a schematic block diagram of a power generation 



resolution is more detailed than at preceding (lower 
resolution) levels and is based on a more localized and 



unit ' precise examination of selected information. The hierarchi- 

FIG. 6A is a graphic illustration of the relationship ca i organization dramatically reduces the complexity of 

between output power and time for a power generation unit; 60 information storage and analysis. MDSS allows the use of a 

FIG. 6B is a graphic illustration of the relationship distributed modeling technique with information acquired 

between output power against time (FIG. 6A) overlaid on a and embedded into the model, to synthesize optimal strat- 

corresponding generating cost in terms of BTU/MW; egies of operation. 

FIG. 6C is a graphic illustration of the relationship The multiresolutional knowledge representation forms the 

between output power against time overlaid on generating 65 basis that is used to synthesize feed-forward trajectories of 

cost (FIG. 6B) shown with the accumulation of selected optimal control. The collection of data is performed by 

transients from acquired raw data; testing a process or plant within the boundaries of its normal 
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operation. The benefits of the present invention include a information should allow for functioning with a required 

reduction in the real costs of operating or designing level of information efiBciency. The latter can be achieved by 

processes, with a relatively insignificant expenditure of time a variety of measures, such as prearranged forgetting and 

and effort in the automated analysis of available system consecutive generalization of experiences based upon uni- 

information. 5 fying experiences which are similar in preconditions, action, 

MDSS allows at least three modes of operation: off-line, and effect but having a lower resolution of representation, 
on-line, and design phase. Off-fine mode provides supervi- The latter produces eventually a hierarchical system for 
sion and planning of process information. On-line mode storage and retrieval of experiences, 
provides monitoring and control of processes according to The associative fusion of data module 32 forms a state- 
predefined criteria of optimality. Design phase mode pro- 10 ment of rules from the data stored and organized by the 
vides selection of system or process components which experience organizer module 30. The rules differ in the 
reduce the cost of achieving required process performance degree of belief which is assigned based upon repetitiveness 
targets. of the particular experiences (statistical) or trustworthiness 

Referring now to the drawings, wherein the same refer- of the Particular source of information (expert). The asso- 

ence numeral designations are applied to corresponding 1S ciative . fusio J 1 of data moduIe 32 comprises means for 

elements throughout the several figures, there is shown in extraction of goal-independent data from the stored goal- 

FIG. 1 a schematic architectural block diagram of a multi- de P ecd&nt f experiences , m the form of generalized rules, or 

resolutionaldecisionsupportsystemlOofthepresentinven- ^P™ of an automata transition function and state- 

f . f , i j *~ output functions. The extraction means may comprise any 

tion for generating input commands or control commands 12 standard al ithm and/of dure for experi- 

for complex systems, e.g. a manufacturing facility, a robot, 20 mental causalities ml0 the stateme nts of rules. Preferably, 

a power plant or corresponding processes 14. The control more sophisticated procedures are applied to the organized 

commands 12 are generated based on a calculation by the data> linked with algorithms and procedures of fusing the 

system 10 of an optimal trajectory or path for achieving a experiences into "associative clusters". Such clusters form a 

predetermined, desired output behavior of the plant or function oriented, goal -independent provisional model of 

process 14. The data 16 is input to the system 10 from 25 the plant or process 14. In order to obtain such provisional 

sources of data 18. The sources of data 18 monitor a plurality models, a mechanism of "consecutive generalization" is 

of variables of functioning constraints and cost-functions of applied based upon unifying groups of higher resolution 

the plant or process 14. The sources of data 18 may comprise information into lower resolution units. However, instead of 

sensors (not shown) which monitor the operation of sub- using experiences similar in preconditions, action, and effect 

systems of the plant or process 14. The sources of data 18 30 as inseparable units (as done by the experience organizer 

may be interpreted also, as humans observing the process module 30), the associative fusion of data module 32 looks 

and submitting the required information. In FIG. 1, arrows for similarities in components of the experiences, which 

connecting certain blocks are shown which represent the leads to rules generation without explicit demonstration of 

direction and flow of information between such blocks. partial dependencies demonstrated in the acquired data 16. 

The system 10 may be broken down into a plurality of 35 Multiple goal-independent and time-independent rules are 

subsystems, with each subsystem including one or more clustered into more general rule statements, thereby produc- 

operational modules. A first organizational subsystem 20 m g eventually a hierarchical system for storage and retrieval 

acquires all input based information, such as the data 16, and of niles from which the provisional relational model of the 

organizes such information for use by a modeling subsystem P^nt or process 14 is combined subsequently. 

22. The modeling subsystem 22 determines functional rela- 40 The resolutional structure development module 34 com- 

tionships of the organized data, which are searched by a prises means for developing a multiresolutional data 

behavior generation subsystem 24. The behavior generation (knowledge) structure based upon the "associative clusters", 

subsystem 24 generates the control commands 12, which are which can transform the provisional relational model into a 

provided to an actuator block 26. The actuator block 26 multilevel hierarchical relational structure with any required 

translates the control commands 12 into process control 45 number of levels of resolution, including embedded local 

signals 28 for physically controlling, modifying or altering dynamics of the plant or process 14. Such multiresolutional 

the operation of the plant or process 14. data structure development means include standard algo- 

The first organizational subsystem 20 preferably com- rithms and procedures for clustering and hierarchical order- 
prises an experience organizer module 30, an associative ing of the units forming the relational model. Although such 
fusion of data module 32, a resolutional structure develop- so conventional means can be used, the interpretation of the 
ment module 34 and a matching the structure of vocabulary results, preferably the process of hierarchical ordering, ends 
module 36. The experience organizer module 30 comprises wnen tne resolutional structure of representation is obtained, 
means for acquiring, organizing, and storing information, wherein each level is associated with a particular resolution 
such as the data 16, which is related to predetermined leve l of the plant or process 14. 

variables of interest of the plant or process 14. Preferably, 55 The matching the structure of vocabulary module 36 
the acquired data 16 is organized into goal dependent units comprises means for matching a statement of the assignment 
of information, such as time-tagged quadruplets "state- to the content of the provisional model with at least one level 
before -act ion, state -after- value" strings, also termed "expe- of resolution. The statement of the assignment defines a 
riences". The experiences are classified in order to permit desired predetermined output of the plant or process 14. 
accurate and plausible inferences to be drawn therefrom. 60 Such means for matching may comprise any standard algo- 
Accordingly, the experience organizer module comprises rithm and/or procedure for component-by-component list 
storage structures which allow for memorizing the goal- browsing and for ordering the lists in correspondence, 
dependent quadruplets of "experiences" and organizing their The aforedescribed modules 30-36 form a unified sub- 
subsequent classification. Since the incoming flow of "expe- system 20 of organization of sensory (and any input-based) 
riences" for any process is generally very large, the volume 65 information. The number of modules shown is not related to 
of memory required has a tendency of growing very quickly. the number of the resolution levels which can be obtained by 
Thus, the storage structures for acquiring and organizing the system 10. 
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The modeling subsystem 22 preferably comprises a recur- process of searching is preferably repeated consecutively at 
sion driver module 38, a bottom-up formation of resolu- one or more levels of resolution with narrowing the search 
tional clusters module 40 and a top-down focusing of envelope and consecutive refinement of the results if the 
attention module 42. The recursion driver module 38 com- representation contains more than one resolution level, 
prises means for guiding and coordinating bottom-up and 5 The execution and compensation module 50 comprises 
top-down recursive processes of knowledge organization means for distributing planned sequences of control corn- 
performed by the bottom-up and top-down modules 40, 42. mands 12 among the actuators of the actuator block 26, 
Such guiding and coordinating means include any standard comparing a planned output with a real output, and intro- 
algorithm and/or procedure for registering, nesting and ducing a compensation command component (i.e. a feed- 
checking conditions of inclusion and monitoring imposition 10 back si S° al ) under a Particular (previously selected) control 
of quantitative constraints. * aw al eac ^ * eve ^ °^ res °l ut i° n - Such command distribution 
rp« . tt c .. r , . , , i , means include any standard algorithm and/or procedure of 
ine Doitom-up tormalion ol resolulionat clusters module iflverti the lanQed t tQ ^ m of 

an actuator and 

40 comprises means for bottom-up formation of multireso- introducin g a feedback law of compensation. 

lutional clusters which provide for further development of tu u u - «• j i m • c 

j i r 4 u i * ia c • • i k Ine behavior generation module 52 comprises means for 

the model of the plant or process 14 from a provisional 15 . f p • .u • i j 1^ . L i , , 

, , . . \. , K i ... + , t y , , r interfacing the control commands 12 to the actuator block 

model into an applied model with at least one level of uc «? u ■ t *■ • i j h * j j i -*t. j 

i c u t u «* ? *• • i ^ in 26. Such mtertace means include all standard algonthms and 

resolution. Such means tor bottom-up formation include all i r . . . & , 

* j j i j , r i * • • i j- procedures lor providing communication between 

standard algorithms and procedures tor clustenne, including « * . , ,r j- j i • t • 

t , j j i t • 11 .i. subsystems, such as a plurality of individual signal wires, a 

such standard solutions as K-means, as well as any another . * j j • i • 

, ... . . , n . . *• i r DUS structure, encoded signal generation, etc. 

algorithmic tool of cluster generation. After completion of 20 ^ . . , «. . , 

the cluster generation, the cluster generation algorithm is TOe matchl °S the structu ^ e ° f ^ cabu , lal ? module 36 ' the 

applied to the newly created clusters, which may be con- constra > n t s adjustment module 44 and the cost funct.on 

sidered as objects, in a recursive fashion. ' preparation module 46 may also be grouped together or 

^ , r . , , ^ . unmed as a second, separate, organizational subsystem 54, 

The top-down focusing of attention module 42 is since these modules 36; 44 4fi ferabl in a 

expenence-based and goal-onented, and serves the purpose coordinated fashion as an organizal i ona i infrastructure of the 

of complexity reduction. The top-down focusing of attention contro i tem 10 xhe &nction of the organizational 

module 42 comprises means for top-down focusing attention tem 54 is hesis of . Wue jud „ M fof 

uponasubsetofdatawithinthemodeloftheplantorprocess se]ectors of the multi , e procedures employed within the 

14 and developing "envelopes of attention" at each level of S y S tem 

resolution. Such top-down focusing means may comprise 30 ^ nQw 

any standard algonthm and/or procedure for data and Iknowl- ^ * ferred em b odiment of a computer . based 

edge pruning by imposing constraints and boundaries. f £n * • , f - , u * i . 1A ^ L 

to r & system 60 for implementing the control system 10 of the 

The system 10 further preferably comprises a constraints present invention is shown. In the presently preferred 

adjustment module 44. The constraints adjustment module 35 embodiment, the computer system 60 includes a processing 

44 includes means for adjusting the constraints of the device or com puter 62 which preferably is a personal 

assignment (desired output) under the vocabulary to the computer or equivalent. The computer 62 includes a read 

results of further development of the model over the mul- onIy mem0 ry (ROM) 64 employed for storing fixed infor- 

tiresolutional model. Such adjusting means include any mat i on including a computer program and random access 

standard algorithm and/or procedure for checking numerical 4Q memory (RAM) 66 of a predetermined size which is adapted 

conditions for interval assignment and introducing of cor- for t emp0 rary storage of portions of a computer program as 

rections in a case where the conditions are not satisfied. weU as data for ana i ys i s . The computer 62 further includes 

The behavior generation subsystem 24 includes a cost a central processing unit or processor (not shown) and, in the 

function preparation module 46, a trajectory (path) search present embodiment, a hard disk (not shown) of a type 

module 48, an execution and compensation module 50, and 45 typically employed in such personal computers. While it is 

a behavior generation module 52. The cost function prepa- presently preferred that the computer 62 comprise a personal 

ration module 46 comprises means for adjusting a cost computer, it should be appreciated that any other suitable 

function, formulated in the assignment (desired output), to type of computer, such as a lap-top computer, mini 

the model with multiple envelopes of attention. Such adjust- computer, microprocessor, digital signal processor, main- 

ing means include any standard algorithm and/or procedure 50 frame computer, work station, etc., may alternatively be 

for assigning and computing a measure for a particular space employed. 

(representation). A keyboard 68 is employed as the primary input device to 

The trajectory (path) search module 48 determines a permit a user to communicate with the computer 62, 

preferable measure of the space, which is preferably based although other input devices may also be used instead of or 

both upon additive and multiplicative forms, and comprises 55 in addition to the keyboard 68, such as a mouse, a joy stick, 

means for searching within each envelope of attention for voice commands, etc. A display, in the present embodiment 

the assignment of the output motion and input planning/ a CRT display 70, and a suitable printer 72 are connected to 

control commands, which provide for the required cost- the computer 62 for the display and recording of output from 

function under the particular set of constraints. Such search- the computer 62. However, it should be understood that any 

ing means include any standard algorithm and/or procedure 60 other type of output device may be employed in addition to 

for different types of search, such as depth-first, breadth- or instead of the display 70 and/or printer 72. Use of the 

first, Dijkstra, A-star, random search, genetic search, etc., as sophisticated output devices employing visualization of 

well as techniques of dynamic programming. It will be abstract concepts, virtual reality, etc., can make application 

understood by those of skill in the art that different kinds of of MDSS more convenient but does not affect its principles 

searching may be preferable for different systems in differ- 65 of operation. 

ent cases. Since the model of the plant or process 14 The computer 62 further includes at least one communi- 

generally contains one or more levels of resolution, the cation port 73 which may be either a parallel port, a serial 
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port, or both. The communication port 74 is employed for filtered analog output signals from the corresponding signal 

receiving data from another location or sending data to conditioner 74 and convert the received analog signals at a 

another location utilizing a modem or other such transmis- predetermined sampling rate into digital signals for data 

sion device (not shown) in a manner well known in the manipulation and analysis by the computer 62. A typical 
computer art. 5 sampling rate could be 1,000 samples per second for each 

The computer system 60 as thus far described is typical of signal. Thus, each of the analog-to-digital converters 76 
a personal computer system well known to those skilled in produces an output data array or bit stream corresponding to 
the art. Variations in the input/output components of the the part i cu i ar sensor with which the analog-to-digital con- 
computer system 60 may be made depending upon particular verier is associated 
applications. For example, in some applications, it will not 
be necessary for both a printer 72 and a display 70. In other 
applications, a keyboard 68 may not be necessary. It should, 
therefore, be clearly understood by those skilled in the art 
that the present invention is not limited to the particular 
hardware configuration shown in FIG. 2 but may be imple- 
mented using any type of suitable hardware configuration. 

The computer system 60 further includes a plurality of 
individual sensors shown collectively as the sources of data 
18, for monitoring predetermined electrical, mechanical and 11 ^ be appreciated by those skilled in the art that the 

other variables of the plant or process 14, and for converting 20 sl S nal conditioners 74, analog-to-digital converters 76, and 

the monitored characteristics into electrical signals multiplexer 78 which are employed in connection with the 

(representing the data 16) for processing by the computer 62. Presently preferred embodiment, are each of a type well 

In the present embodiment, the sources of data 18 includes known in the art and available from a variety ol manufac- 

a variety of different types of individual electrical and/or turers / Com P lele ***** of lhe structure and operation of the 
mechanical sensors of a type well known in the electrical 25 signal conditioners 74, analog-to-digital converters 76, and 

and mechanical measurement art and commercially avail- multiplexer 78 are generally well known to those skilled in 

able from a variety of well known sources, such as vibration the arl and need not be described in greater detail herein, 

sensors, acoustic sensors, tachometers, pressure transducers, Suffice it to say that the signal conditioners 74, analog-lo- 

proximity probes, force sensors, torque sensors, temperature dl g ltal converters 76, and multiplexer 78 cooperate to take 
sensors, flow meters, voltage sensors, current sensors, etc. 30 the raw operational data 16 from me sensors and convert the 

Complete details of the structure and operation of the raw data " , m T t0 a dl f tal form . sui ^ ble f or Pressing by the 

various types of sensors for use with the present invention is computer 62. It will be appreciated by those slaUed in the art 



The outputs of each of the analog-to-digital converters 76 
are provided to the input of a multiplexer 78. The multi- 
plexer 78 which, in the present embodiment is preferably a 
time division multiplexer, receives the data array signals 
from each of the an alog-to -digital converters 76 and in a 
manner well known in the art transmits the received data 
array signals to an appropriate serial input port 80 of the 
computer 62 in a predetermined time spaced order. 



not necessary for a complete understanding of the present 



that the functions of the signal conditioners 74, analog-to- 



invention. The particular type of sensors employed in the di S ital converters 76, and multiplexer 78 may be combined 



presently preferred embodiment should not be viewed as a 
limitation upon the invention. Each of the sensors are 
adapted to receive and convert sensed parameters related to 
the operation of the plant or process 14 into analogous 



into a single sub-assembly or may be performed in any of 
several different manners. Thus, while the preferred embodi- 
ment employs such components, such components are not 
intended to be a limitation on the present invention. Thus, 



standard electrical signals. In addition, as previously the senso / s ' sl S Dal conditioners 74, an alog-to -digital con- 
discussed, a human operator can be considered a valid 40 v u erters 76 and multiplexer 78 provide for data logging, and 
source of the input information, supplementing or substitut- computer system 60 provides for either analyzing the 
ing the set of sensors ~ collected data or down-loading the collected data to another 

The computer system 60 further preferably includes a processor (not shown), 

plurality of signal conditioners 74 which are illustrated The present invention is capable of handling on-line 

collectively. Preferably, a separate signal conditioner is 45 information acquisition, disk-transfers, and manual data 

provided for each of the sensors, with the respective output entr V- In addition, a one-way communication link with the 

of the sensor being connected directly to the input to the sensors and transmitters (not shown) can also be provided, 

respective signal conditioner 74. Each of the signal condi- smce the operation of the system 60 can be decoupled from 

tioners 74 functions in a manner well known in the art to that of the P lant or process 14. Further, the present system 60 

amplify, impedance match, filter, scale, and otherwise stan- 50 can be inte grated relatively simply with existing control 

dardize and improve the electrical output signal received systems which are capable of computer interface or contain 

from the corresponding sensor. Standardization of signals PC levei processing capabilities. 

representing the data 16 includes conversion of currents to The above-described computer system 60 is employed for 

a proportional voltage, amplitude scaling and appropriate both on-line and off-line analysis of the operation of the 

filtering to limit bandwidth. The precise structure and opera- 55 plant or process 14. It should be appreciated by those skilled 

tion of each signal conditioner depends upon the particular in the art that the present system 10 may be employed for 

type of sensor with which the signal conditioner 62 is analysis of any type of process, plant or facility whose 

employed. Preferably, each of the signal conditioners 62 operation is controlled by a plurality of variables, and that 

further includes an anti-alias low pass filter which functions the embodiment shown in FIG. 2 is only for the purpose of 

to improve the integrity of the acquired sensor data by eo illustrating a preferred embodiment of the structure and 

filtering out, prior to digitizing, sensor signal frequencies operation of the present invention. 

greater than approximately half of the sampling rate of the Referring now to FIG. 3, a schematic block diagram of a 

digitizer. mu Hire solution al intelligent control architecture in accor- 

The computer system 60 further includes a plurality of dance with the present invention is shown. The structural 

individual analog-to-digital converters 76 shown collec- 65 hierarchy of a typical system, denoted 100, is shown with 

tively. The an alog-to -digital converters 76 function in a individual system elements comprising several levels of 

manner well known in the art to receive the conditioned and abstraction. FIG. 3 labels "task" through "actuator" levels, 
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in order of increasing specificity. This partitioning reflects description of this principle). The ability to analyze gross 
the fact that the operating points of the system 100 are behavior, as well as local perturbations is also built in for 
frequently expressed in terms of subsystems, subsystem efficient analysis of alternatives. The source of a model can 
components, and so on, down to individual actuators within be tested or carried out on any of an existing plant, an exiting 
the overall system. In order for the complete system 100 to 5 dynamic model of more or less arbitrary complexity, or a 
function properly, each subsystem and all of the subsystem custom-built model with elements that include rules, look- 
components and actuators must correctly follow their pre- up tables, equations, and empirical data. Subjective and 
scribed assignment. The system 100 uses strings of states, inconsistent, as well as traditional cost or penalty criteria are 
instead of single states, and an experiential knowledge base, locally evaluated and incorporated into a model for future 
instead of conventional models, as discussed in more detail 1Q analysis. The overall strategy is thus one which places the 
below. burden of determining and achieving performance goals 
Generally, the system 100 comprises a preprocessing upon the control system, as opposed to a system designer, 
subsystem 102, a representation subsystem 104, a planning The present invention reinforces the feedback control com- 
or search subsystem 106, an arbitration subsystem 108, a ponent of a control system, using the byproduct of the 
prediction or optimization subsystem 110, and a stabilizing 15 planning subsystem 106 and the planning component (using 
feedback subsystem 112. The plant or process 14 being learning algorithms and the feedback derived from system 
controlled is monitored by a plurality of sensors, as previ- operation), the control system 100 is provided with the 
ously discussed, which sensors provide data 16 for use by attributes of intelligence. 

the system 100. The plant or process 14 includes several The major operational steps of the present invention are 

levels of data acquisition for a general multicomponent 20 preprocessing and data analysis, multiresolulional model 

system running several concurrently actuated loops. The design, cost evaluation and process improvement. The first 

levels may be derived from physical considerations, such as step, preprocessing and data analysis, provides an adequate 

dependence of one loop on a satisfactory operation of description of the plant or process 14 by constructing and 

another loop. The operation of the control system 100 is validating a distributed multiresolutional provisional model 

discussed below. 25 0 f the plant or process 14. The multiresolutional model may 

The plant or process 14 performance can be measured by be validated using a multi -valued graph representation, as 

a variety of yardsticks, including financial savings, the described in more detail below. Cost evaluation may be 

meeting of regulatory standards, maximization of the opera- performed using a sliding window to compute the costs of 

tional life of a plant, and minimization of the need for operation of the process in a tangible form. The sliding 

operator intervention (reliability). As long as the cost 30 window permits the application of the model for process 

measures, however objective, are tangible and may be improvement which can then be measured in a consistent 

evaluated from measurements, they can be incorporated into manner. The width of the sliding window is determined by 

the present control system 100, either separately or in a the actual discretization of the available information and the 

weighted combination. As opposed to prior art analytical required accuracy of results. The process improvement step 

approaches, there is no constraint on the simultaneous 35 represents the continual improvement of the process by 

evaluation of cost by a variety of measures. applying search and optimization algorithms to the distrib- 

The overall strategy of optimization and successive uted model. Critical but previously unknown relationships 

refinement employed in MDSS is contingent upon the of the process may be discovered during the preprocessing 

creation of a multiresolutional representation. The key of information for the model. 

requirements of the system 100 are that it must contain a 40 The preprocessing subsystem 102 preprocesses the data 
generalized representation of system capabilities at a reso- 16 acquired from one or more sensors (not shown) through- 
lution (level) that allows global optimization without vio- out the plant or process 14. The preprocessing subsystem 
lating computational restraints and that each level must 102 is provided for preprocessing raw plant information or 
contain a more dense (precise) representation than the data 16 using hierarchial clustering algorithms in order to 
previous level. If this is achieved, then search at each 45 synthesize a multiresolutional knowledge base. The prepro- 
successive level of resolution generates a more precise cessing subsystem 102 organizes the data 16 in the form of 
solution of the optimization problem. If prior experiences time-tagged quadruplets [SB, A, SA, V] where SB is "state- 
are inform ationally rich, the process of optimization is based before", A is "action", SA is "state-after" and V is "value" 
on such rich experiences, and if prior experiences are poor, strings. The preprocessing subsystem 102 may comprise, for 
interpolation and extrapolation may be required. 50 example, a storage structure which allows for storing and 
A multiresolutional representation may be visualized as a organizing goal-dependent quadruplets of "experiences", 
hierarchical store of information, incorporating appropri- their subsequent classification, and for performing accurate 
ately quantized descriptions of achievable system responses. and plausible inferences upon the results of the classifica- 
The information is organized by precision into levels of tion. 

increasingly detailed description. Algorithms for the incor- 55 Process variables are identified by plant operators and 

poration of new information into the hierarchy are consid- managers as those being critical to successful operation of 

ered part of the system's knowledge. Thus, a finite set of the target system, process or plant 14. Another way of 

information about the system 100 is assembled, which, in finding this set is clustering with determining existing cor- 

association with search and retrieval algorithms, answers the relations among the parameters. Aset of process variables is 

same questions as the more familiar mathematical abstrac- 60 initially defined and may be updated and expanded during 

tion or model, viz, what is the effect on measurable or the building of a model, if such additional variables are 

identifiable plant variables of a particular excitation. Learn- found to be necessary and are available. The process vari- 

ing is implemented by collecting and integrating experiences ables form what is conventionally known as a state space, 

and by subsequent random testing in the intervals between The state space is bounded by the limits in each process 

experiences. Information about the same objects is repre- 65 variable and may be thought of as an n-dimensional box, 

sented at several appropriate levels of resolution (nested, where V is the number of variables or axes of interest. In 

hierarchical, local decomposition is a complicated but apt general, by virtue of the scope and interaction of parameters, 
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groups of process variables are arranged hierarchically in which is an optimal step on a path to a global objective; a set 

accordance with subsystems of the plant 14, and are viewed of criteria used to determine a path to the assigned objective 

as a single unit at higher levels of abstraction. at the current resolutional level; a description of the system 

At this identification stage, the data 16 is collected at a at the resolution appropriate for the selection of an optimal 

sensor resolution for representing state trajectories in the 5 path with respect to the objectives of the level; and optimi- 

form of strings, S(x)=x(t+kAt) for k^O. Arecursive approxi- za tion algorithms for synthesizing the optimal strategy based 

mation is then performed which organizes the data 16 on the on me prev ious three elements 

basis of successively more precise state transitions in the In order to obtain such a provisional modelj a mec hanism 
orm " of consecutive multivariable clustering is applied, interpret- 
{AXir 1} x 2 €S(x) 3 and Jx^^c},. io able as generalization. The provisional model is also based 
where e 2 is a measure of the level of precision (or resolution) u P on unifying groups of higher resolution information into 
of the transitions. The feasible transitions are ranked on the lower resolution units. However, instead of using experi- 
basis of a measure of the cost of the transition which is ences having similar preconditions, action and effect as 
dependent on a cost function of interest and are stored as inseparable units, similarities and components of the expe- 
graphs of the appropriate level of resolution. The graphs 15 riences are used, which leads to rules generation without 
have a structure which may be described by an ordered set explicit demonstration of partial dependencies demonstrated 
(y p > V o Q U t ) which may be considered as a parent vertex, in the raw data 16. Multiple goal-independent and time- 
a child or successor vertex, the cost of the transition from the independent rules are clustered into more general rule state- 
parent to the successor, and the associated input code. The ments which produce a hierarchical system for storage and 
hierarchy of graphs allows the examination of previously 20 retrieval of rules. 

encountered local behaviors at increasing precision in a Preferably, the representation subsystem 104 further uses 

reduced subset of the underlying states which, in turn, the process of local interpolation, which introduces local 

permits the synthesis of more and more precise strategies of errors in the computed costs of transitions in the graph. In 

operation with reduced search complexity. order to establish that the errors which are introduced in this 

Since the construction of the hierarchical store of infor- 25 matter do not accumulate, several corrective measures may 

mation is predicated on appropriate multiresolutional dis- be taken. The simplest of these measures is to introduce a 

cretization of the subset of the state space in which the randomized shift to the discretization that is used for the 

system 100 operates, and since the data 16 is collected with graphs. The resulting structure is, therefore, organized as a 

a precision that is, in general, not the same at each particular random constellation of points of the state space rather than 

level of the hierarchy, local interpolation is necessary to 30 a conventional grid. In order to test the structure for a 

determine feasible edges in the graphs. The search for uniform distribution of errors, it is preferred to synthesize 

feasible edges does not require abandoning the acquired data test trajectories and examine their estimated costs in con- 

16. Rather, the data 16 remains the basis point of the junction with previously examined trajectories of operation, 

representation system while temporary nodes are computed The planning subsystem 106 searches the knowledge base 

so that the experiences can be adjusted to the required level 35 generated by the preprocessing subsystem 102 and the 

of resolution. representation subsystem 104 to select an optimal course of 

The preprocessing subsystem 102 can be considered to action (trajectory) and generates corresponding feed- 
perform the function of an observer, as well as a filter. forward control signals 114 which are sent to the arbitration 
Depending on the novelty or usefulness of the collected subsystem 108 to carry out a predetermined assignment 124. 
information or data 16, the preprocessing subsystem 102 40 The assignment 124 for the system 100 includes a descrip- 
passes filtered data 16 to a learning subsystem 126 and/or to tion of a task to be performed, as well as any additional 
the representation subsystem 104 directly. A bidirectional information, such as performance criteria or special consid- 
arrow, denoted 128 connecting the preprocessing subsystem erations. The knowledge base may be searched either on-line 
102 to the learning subsystem 126 represents handshaking or off-line. The planning subsystem 106 requires input from 
signals for coordination purposes, in addition to a data path 45 the representation subsystem 104 and possibly, from the 
for passing the filtered data to the learning subsystem 126. learning subsystem 126. The output of the planning sub- 

The representation subsystem 104 is a multiresolutional system 106 comprises planned trajectories for variables and 

storage structure for organizing the system knowledge the feed-forward control signals 114, as well as the local 

which integrates the information of experiences, i.e., the information 120 retained from its most recent search, 

data 16 organized by the preprocessing subsystem 102. so The following properties of tessellation are provided by 

Although the representation subsystem 104 may receive the preprocessing and representation subsystems 102, 104 

information on-line, the information may also be loaded or which support the minimum-cost search for the planning/ 

partially loaded off-line and updated either directly through control trajectory. First, for systems with continuity, a recur- 

the preprocessing subsystem 102 or via the learning sub- sive process of tessellation is assigned with a metric which 

system 126. The representation subsystem 104 extracts 55 generates a hierarchy with a virtue of addressability of all 

goal-independent data from goal-dependent data in the form tessellata. The "all- thro ugh" addressability of the hierarchy 

of generalized rules, or components of the automata transi- is achievable using a decomposition strategy which allows 

tion function and state output functions. For instance, stan- for the property of having the state space address fully 

dard algorithms and procedures for inverting experimental contained in the tessellatum name together with the level to 

causalities into statements of rules may be used to extract 60 which the state space belongs. Thus, the subsequent search 

goal-independent data. More sophisticated procedures can cannot miss or misrecognize a tessellatum. Thus, the algo- 

be applied, linked with algorithms and procedures of fusing rithm of reconsidering the hierarchy and adjusting the hier- 

the components of experiences into associative clusters. archy is built into the system. Second, among all possible 

Such clusters form a function-oriented, goal-independent hierarchies which can be achieved by a space tessellation, 

provisional model of the plant or process 14. 65 there exists one hierarchy which delivers the most efficient 

The necessary components of a single level of a multi- (minimum cost) operation to the system to be controlled, 

resolutional representation may be identified as: a goal Thus, the system is tuned in such a way as to have the 



6,102,958 



19 



above-mentioned number of hierarchical levels and the 
algorithm of tuning up the hierarchies is built into the 
system. Finally, by associating the tessellata with their 
centers as the representatives lead to detrimental results; the 
excessive organization of the space creates biased motion 5 
(the well known idiosyncracies of the grids). Therefore, 
representing the tessellata not by their centers but rather, by 
randomized representatives heals the process of computa- 
tion and motion in the system. Thus, the algorithm of 
randomization in assigning the representative for a tessel- 10 
latum is also built into the system. 

The present invention embeds the results of the examining 
operation under different regimes exercised by a lower level 
control subsystem. Each elementary transition which fits 
within the constraints of being a transition from one tessel- 15 
latum to another, is assigned the values of state transition in 
the corresponding costs obtained from the on-line measure- 
ments (at the particular resolution determined by the level of 
tessellation). The value of error is assigned in such a way as 
not to exceed the "size of a tessellatum" accepted at a 20 
particular level of resolution. Thus, a device for embedding 
local dynamics is also built into the system. 

Several methods of search for optimal trajectories may be 
applied to the graphs pertaining to a particular level of 
resolution. For instance, Dijkstra's algorithm (or its heuristic 25 
evolvement, A-star algorithm) may be used, as follows: 



For each child 

5.1 If the number of occurrences of the child 
are less than the prearranged limit, add 
the new data to the tree and mark the new 
child "open"; 

5.2 Else if the new child has a lower cost than 
all existing ways of getting to that child 
then 

5.2.1 If the same (to, from) pair 
exists in the tree replace it 
with the new data and mark the 
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-continued 



5.2.2 



5.2.3 



Else 
5.3.1 



new child "open"; 

Else if two identical (to, from) 

pairs exist in the tree replace 

the more expensive one with the 

new data and mark the new child 

"open"; 

Else replace the most expensive 
(to, from) pair with the new data 
and mark the new child "open"; 
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Initialize a searah tree of size equal to the 
number of nodes in the graph with the edge from 
the start node to itself, with a transition cost 
of zero, and mark it "open" for future 
examination; 

Select the cheapest "open" node in the tree and 
mark it "closed" (investigated); 
If the goal node is achieved, traverse pointers 
to retrieve the solution path; 
Expand the current node, generating all of its 
successors (children) from the graph; 
For each child which has not been previously 
expanded 

5.1 If the child is not in the "to" column of 40 
the tree, add the new edge, else 

5.2 If the existing cost to reach the child is 
higher than the newly determined cost, 
switch the source node and the cost on the 
existing edge; 

Go to step (2). 45 



In the presently preferred embodiment of the invention, 
the above algorithm is modified to incorporate suboptimal 
variations by implementing changes in step (5). The purpose 
for the modification to step (5) is to allow successive 
refinement of the results found at low resolution to provide 
increasingly precise approximations to the globally optimal 
strategy of operation. Thus, step (5) is preferably modified, 
as follows: 



If the same (to, from) pair 
exists in the tree and it is more 
expensive replace it with new 
data and mark the new child 
"open"; 

3.2 Else if two identical (to, from) 
pairs exist in the tree replace 
the more expensive pair with the 
new data; 

5.3.2.1 If the replaced edge was 
more expensive, mark the new 
child "open"; 

5.3.2.2 Else add the incremental 
cost of the more expensive 
substitution to edges built 
from the previous node, if 
it has already been 
expanded; 

3.3 Else if the new pair is less 
expensive replace the most 
expensive (to, from) pair with 
the new data and mark the new 
child "open". 



An envelope surrounding the result at each level of 
resolution is determined using the following algorithm: 



50 



Initialize a table of size equal to the number 
of nodes in the search graph with the goal node 
and the cost of including in the optimal path to 
itself as C Mt (xpt)=0 and C min (x,a)=cost of the 
optimal path. 

For each open node, k, in the table: 

2.1 Mark the node closed; 

2.2 Compute an estimate for the cost of 
reaching the goal from each predecessor 
node, k-1, using C Mt (x,k-l) = 

C e8I (x,k)+c(k>l); Derive c(kJi-l) from 
the original graph and determine, from the 
search graph, the optimal cost C min (k-l,a) 
of reaching k-1; 

2.3 If the existing value of C M (x,k-l) is less 
than currently in the table, replace it, or 
if k-1 is not in the table, add it to the 
table and mark the node open; 

Go to step 2. 



The solutions are then refined in the new envelope by 
tessellating the space confined within the envelope at a finer 
level of resolution using the distributed store of data to fill 
in that volume only, thereby controlling the potentially 
explosive growth of complexity associated with conven- 
tional strategies of search for optimization. The width of the 
envelop is chosen based on known specifics of the problem. 
By providing search in the state space, analytical models are 
not required, and computations are both simplified and 
continually updated. 

The prediction subsystem 110 generates suggested pre- 
diction control signals 116 for achieving optimal perfor- 
mance or operation of the plant 14. Local information or 
data 120, which is a byproduct of increasingly focussed 
search by the planning subsystem 106, is transferred to the 
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prediction subsystem 110 as a set of increasingly precise 
investigations of successively tighter envelopes of a nominal 
trajectory. The prediction subsystem 110 operates on the 
principle that the best local course of action can be pre- 
planned to multiple short horizons in real-time by investi- 
gating the local data or information 120 generated by the 
planning subsystem 106 in conjunction with the plant data 
16 and the predetermined assignment 124. Preferably, the 
prediction subsystem 110 is a predictive compensator. 

The stabilization subsystem 112 is an optional element of 
the control system 100. The stabilization system 112 gen- 
erates a set of safety control signals 118 for assuring that the 
system operates within a predetermined range, i.e. a range of 
safe operation. For instance, the safety control signals 118 
may comprise shut-off signals for turning off a piece of 
equipment or machinery which is operating outside of a 
predetermined safe range of operation, such as outside of a 
predetermined temperature range. Use of the stabilization 
subsystem 112 presumes the knowledge of some suboptimal 
but safe compensation to which the system 100 may revert 
in the event of unexpected or destabilizing behavior. 
Alternatively, the plant 14 may be equipped with stabilizing 
feedback before the synthesis of the optimizing control 
signals 114. 

The learning subsystem 126 correlates actual and 
expected performance data and continuously updates the 
preprocessing subsystem 102, the representation subsystem 
104 and the planning subsystem 106. Preferably, a display 
70 is coupled to the learning subsystem 126 which prefer- 
ably combines graphical and textual information to allow a 
user to monitor operation of the system 100. 

The arbitration subsystem 108 receives the feed-forward 
control signals 114 and generates corresponding process 
control signals 28 for controlling the operation of the plant 
or process 14. The arbitration subsystem 108 depends on the 
mode of operation of the overall system 100. In its simplest 
configuration, the arbitration subsystem 108 superimposes 
the excitation or feed -forward control signals 114 suggested 
by the planning subsystem 106 on the control signals 116, 
118, respectively, computed by the compensatory elements, 
i.e., the prediction subsystem 110 and the stabilization 
subsystem 112. If, because of distributed decision making 
between the sources of actuation commands, prespecified 
limits such as hard bounds on inputs are violated, the 
arbitration subsystem 108 has the ability to modify the 
effective actuation accordingly. In case of unexpected 
behavior from the plant 14, the arbitration subsystem 108 
can be used to switch out individual components of the 
actuating signals 114 or to halt operation of the plant 14 
completely. Thus, the arbitration subsystem 108 acts as a 
summer or switch to the plant 14. 

The control strategy of the present invention differs from 
the prior art (which tends to focus on analytical represen- 
tations and parametric equations) by developing solutions 
(control signals) from the acquired data 16 at multiple 
resolution levels and sharing the control signals 114 in both 
an upward and downward fashion to satisfy the requirements 
of the system 100 as a whole, as well as system components. 

The present invention eliminates the stage of mathemati- 
cal abstraction and parameter identification and instead, uses 
collected measurements (the data 16) to form a distributed 
multiresolutional knowledge representation which is oper- 
ated upon by search algorithms. The present invention 
eliminates the need for an explicit choice of a mapping from 
empirical data to a particular model structure and the con- 
ventional equations are replaced by a distributed represen- 
tation. 
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The operation of a power generating station provides 
opportunities to study the symbiotic relationships of depen- 
dent and independent process variables at multiple and 
discrete levels of resolution. The required megawatt (MW) 

5 output demand of a power plant is controlled by a unit load 
control system. The output demand value is used in a 
constraining function to control power plant subsystems 
(e.g., fuel/air, feed water, turbine valves, etc.) such that the 
required megawatt demand is met. The need for an 

10 integrated, multiresolutional view of complex systems 
emerges as a result of attempting to obtain optimal perfor- 
mance from the system as a whole when it may, without loss 
of generality, be viewed as a collection of interacting 
subsystems-each with its own parameters, constraints, opti- 

15 mization criteria, cycle times, and each itself composed of 
interacting subsystems. 

A typical organizational approach of operating power 
plants at multiresolutional levels of information comprises 
operations designed and submitted for execution at succeed- 

20 ing resolutional levels on the basis of a priori information 
concerning safe and achievable targets. By not implement- 
ing a representation for the incorporation of feedback from 
lower levels, higher level decision makers are typically not 
in a position to set targets which are truly the "best" by 

25 objective criteria. Examples of such criteria for a power 
plant are: maximum efficiency of energy conversion; mini- 
mum emissions; maximum reliability of equipment and 
systems; and maximum flexibility of operation. In general, 
the list of potential performance criteria is large, but not as 

30 large as the number of controlled variables in the power 
plant, which number in the thousands. The organization of 
the variables into a hierarchy of significance (with respect to 
the most general aims of the process) is the first step in 
building a hierarchical representation of the system. This 

35 hierarchy of significance, while grounded in the basic phys- 
ics of the process, is made at each level of the organizational 
hierarchy. As a result, although the fuel/air ratio has a very 
significant effect on unit performance, the scheduling of 
plant operations by the management level is typically driven 

40 by a monthly, or quarterly value of average efficiency, rather 
than variables of that nature. 

Referring now to FIG. 4, an electric grid 150 which 
supplies power to a region is managed by a power company 
152, with power generated by several utility companies 154, 

45 155, 156, each of which generally includes a plurality of 
power plants 158-164, with each power plant 158-164 
generally including a plurality of power generating units 
(not shown). The power company 152 is responsible for 
maintaining stable grid conditions through the use of base 

50 loaded, cycling and peaking power plants. Loading of the 
grid 150 is signaled by the frequency of the power supply by 
the utilities 154-156. Generally, there is a band around the 
60 Hz bus frequency within which the overall system must 
operate, and changes in this frequency indicate that the 

55 power generation capacity of the system must be adjusted. 
The individual utility companies must meet changes in 
capacity within an established time period. 

The average cost of operation of a power plant under a 
utility company's control may be based on a parameter 

60 called lambda which indirectly reflects the cost of generation 
and is a function of both demand and production. The 
scheduling of individual plants is performed on the basis of 
a single averaged indicator. 
Referring now to FIG. 5, a schematic block diagram of a 

65 power generating unit 170 is shown. Generally, the power 
generating unit 170 comprises a source of fuel 172, such as 
a natural gas fine or a fuel storage facility, fuel flow controls, 
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such as a gas flow meter 174 and an oil flow meter 176 for assigned based upon judgments of the power company 152 

regulating and measuring fuel flow. The power generating and the utility companies 154-156. In the power plant 

unit 170, in addition to fuel resource elements, further generating control system in accordance with the present 

comprises power generating elements, such as a boiler 178 invention, three resolution levels of interest are identified on 

for heating feed water 179, a turbine 180 driven by the 5 the basis of current industry practice, as follows: (1) the grid 

heated water or steam, and a generator 182 coupled to the level at which a schedule of operation for each power 

turbine 180 for generating or producing output power 184. generating unit is developed; (2) the unit level where the 

The boiler 178 is also connected to an exhaust stack 186 for required power capacity should be developed in the most 

dissipating emissions, such as NOx and Sox. The power cost effective manner; and (3) the unit system level which 

generating unit 170 has a predetermined range of economi- 10 has been broken down into entities such as fuel management 

cal operation. For instance, the unit 170 may produce power system, feed water system, reheat control system, etc. 

in a range from 90 MW-425 MW, with changes within the Because optimization of fuel consumption directly translates 

output power range varying in multiples of 40 MW. Thus, to the global objective of improvement in unit operating 

for example, an operating point change could be from 320 efliciency, an intermediate unit level of resolution is ana- 

MW to 360 MW or from 120 MW to 400 MW. is lyzed and recommendations (e.g., control signals 114) are 

Operating point changes are usually controlled based on made concerning the operation of a single unit in a manner 

previously established safety/economic criteria. For which reduces costs, in terms of dollars per megawatt sold, 

instance, operating point changes may be limited to 1% per As will be apparent to those of ordinary skill in the art, the 

minute (or 4 MW per minute). The operation is prepro- described analysis and optimization techniques can be 

grammed based on a knowledge of BTU/MW and a fuel heat 20 applied at each level of resolution, and therefore, extensions 

content figure in BTU/fuel unit. Thus, the turbine 180 of this analysis can be made both up and down the hierarchy 

ramping and fuel increase is performed simultaneously of concerns. Having a means of optimizing unit 

(coordinated control), by following a stored curve for each. performance, it is possible to develop an optimal unit 

The BTU/MW is a steady-state figure. Within the power scheduling strategy (a higher level concern) using the same 

generating unit 170, steam temperature should ideally be at 25 tools of analysis. Similarly, the optimal manner of control- 

1000° F. for the first stage of the steam turbine 180 and the ling the unit systems is determined using the unit scheduling 

same at the outlet of the reheater for the secondary stages. strategy as the goal to be achieved at the next level of 

However, at 20% load, the heat produced may not be resolution. 

adequate and the steam temperature at the reheater is Initially, sufficient data must be collected to build a model 

allowed to go as low as 940° F. Similarly, the boiler 178 30 of the process for efficiency analysis. In the electric power 

pressure falls from 2400 psi at full load to around 1050 psi example, currently known data collection techniques may be 

at low load. used. For example, a Bailey Network distributed control 

Feed-forward control (a reference curve or trajectory) is system may be used to collect and maintain a history of the 

used for feed water 179, drum pressure, steam temperature operating parameters for a power plant. Such a control 

and air flow excess in addition to fuel. The fuel supply 35 system provides sufficient data for construction of a model, 

system 172 is operated with feed-forward and feedback The variables initially selected for analysis in this example 

control. First, volumetric consumption for steady-state pro- are based on parameters traditionally used by power com- 

duclion of a particular power output 184 is determined from panies to provide an overview of the unit condition. This 

a stored curve, expressed in terms of the rate at which fuel results in the selection of a redundant set of variables for 

(both oil and gas) is burned to have a sustained supply of 40 which data is collected by a plant control system. For 

heat for the boiler 178, as the boiler 178 supplies the correct instance, in the presently preferred embodiment, data is 

steam conditions to the turbine 180. A volumetric set point collected at one minute intervals over a predetermined 

is provided to a loop that measures differential flow period, such as a five day period. These variables are: (1) 

(consumption). Individual burners are capable of providing gross load; (2) auxiliary load; (3) main steam flow; (4) main 

150 MBTU with a 50% turn down. This means that the 45 steam pressure; (5) main steam temperature; (6) feed water 

operating range of a burner is from MAX/2 to MAX (in flow; (7) final feed water temperature; (8) boiler drum 

gallons/min) and if "n" burners are in service, (nxMAX) pressure; (9) air heater output temperature; (10) turbine 

down to (nxMAX/2) gallons may be forced out of the fuel throttle pressure; (11) fuel temperature; (12) unit fuel gas 

supply nozzles. If more or less fuel is to be burned, addi- flow; (13) unit fuel oil flow; (14) excess air; (15) SOx; and 

tional burners must be brought into or taken out of service. 50 (16) NOx. 

In order to change the flow through the nozzles, the feedback These parameters are culled based on their direct impact 

system changes the differential pressure across the whole set on the global objective of improved unit efficiency in the 

of open nozzles until enough fuel is forced out of the opportunity to control their value. This global objective is 

nozzles. The amount of fuel to be burned is primarily set by formulated for a level of resolution under consideration. For 

the reference curve, however, the number of burners which 55 example, while SOx and NOx are important traditional 

can supply that volume is not unique. The operator in the parameters which characterize an emissions system, SOx 

control room is able to use his experience of usual demand and NOx do not directly impact on the unit efficiency 

and, if he expects a large increase in demand, to introduce (although emissions are monitored to ensure compliance 

several burners early (thereby lowering the flow/burner) in with environmental regulations and to ensure that regulatory 

anticipation of an increase. The flow controller compensates 60 constraints are not a significant factor in the vicinity of the 

for the number of burners by changing fuel pressure to determined optimal operating trajectory). Also, while excess 

contain fuel consumption at the feed-forward set point. air flow does impact directly on the efficiency of the power 

As previously discussed, many systems and processes generating unit 170, air flow is slaved to fuel flow and 

possess symbiotic relationships of both dependent and inde- provides little opportunity for control. Of course, some 

pendent data. In the power plant application, independence 65 dependency relationships exist among the selected variables, 

of variables is minimal. Unit load demand is determined by Moreover, some variables are difficult to control or are 

requirements of the regional electrical grid 150 and is directly related to other parameters. For instance, the tern- 
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perature and rate of flow of the feed water 179 are functions 
of the environment (e.g., water temperature varies with the 
season, for example from 85° in the summer to 35° in the 
winter), and are generally uncontrolled by a power plant. 

The present invention determines a minimal set of vari- 
ables which are used to carry out the desired optimization. 
The etimination of redundant variables allows optimization 
within a lower dimensional space, resulting in exponential 
reductions in complexity. If the performance of a power unit 
is not strongly correlated with certain variables, or if such 
variables can be independently controlled, then the exami- 
nation of the effects of the variables can be deferred to the 
next level of resolution without significantly affecting the 
results of optimization. 

The present invention accumulates selected transients 
from the acquired raw data 16. For example, the generator 
gross power output 184 is identified as the output of the 
system. The input is the total heat supplied per unit timed by 
the combination of fuels. Controllable parameters having a 
direct impact on the efficiency of the unit 170 are turbine 
throttle pressure and main steam temperature. These vari- 
ables were selected based first on assumptions concerning 
thermodynamic state variables and second, on the fact that 
the other variables examined may be treated as constraints 
which must simply be maintained within their normal oper- 
ating range. 

From specifications and actual measurements, the opera- 
tional limits for each variable were selected as follows: 

80^x^450 (MW) 
950^x^1020 (°R); and 
950^x 3 ^2450 (PSI). 

Changes in the operating point of the unit 170 are mapped 
into a close subset of a three dimensional state space. The 
goal of optimization is stated as the determination of the 
trajectory from a particular power, temperature, and pressure 
to another, in a manner which minimizes fuel consumption 
per net MW during the transition along the complete tra- 
jectory from the beginning to the end. 

Optimization is carried out using a multiresolutional 
representation built from the accumulated data 16, rather 
than calculated from a mathematical model. Search algo- 
rithms allow the synthesis of trajectories at several levels of 
precision. The present invention utilizes empirically deter- 
mined information (the data 16) directly, and controls the 
growth of search complexity by recursively examining a 
smaller envelope in the state-space to determine the global 
optimum with increasing precision. The present invention 
performs the following steps: 

(a) Tessellation or discretization; 

(b) Determination of transition costs in the tessellated 
space; 

(c) Search for the optimal trajectory at the current level of 
precision; 

(d) Determining the envelope around the trajectory for 
using at the subsequent stage of refinement; and 

(e) Successive refinement of the trajectory by utilizing a 
finer tessellation (or quantization level) within the 
envelope found at the previous stage. 

Tessellation results in a partitioning of the state space into 
subsets identified by labels corresponding to their state - 
space location. The labels correspond to an indistinguishable 
"vicinity" in the state space and form an equivalences 
relation in conjunction with the indistinguishability mea- 
sure. The smaller the tessellation size, the larger the set of 
labels, by an exponential factor corresponding to the dimen- 
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sionality of the space. The valid transitions in the tessellated 
space are determined from the collected data 16. The tran- 
sitions are established by connecting randomly perturbed 
centers of the tessellata (vicinities or boxes) using evidence 

5 from the data 16. Costs are assigned based on the accumu- 
lation of net costs per unit time over an interval required for 
the completion of each transition. Completion of a transition 
is defined as the point of closest approach to the state 
corresponding to a label, where distance is computed using 

10 the weighted 1-norm for the sake of simplicity. The input for 
each transition is approximated by a piecewise constant rate 
of combustion computed from the average of the rate at the 
start and end of every transition. 

Referring now to FIG. 6A, a plot of the gross power 

15 output 184 developed during a 30 hour period against time 
generated by the preprocessing subsystem 102 is shown. 
FIG. 6A shows the typical behavior required from a power 
plant, such as one of the power plants 158-164. In FIG. 6B, 
the plot of power output 184 against time (FIG. 6A) is 

20 overlaid on a corresponding generating cost in terms of 
BTU/MW. The cost per net MW is computed by sliding an 
adjustable width averaging window along a time axis and 
combining fuel BTU expenditure figures for both oil and gas 
on the basis of measured caloric value. FIG. 6B illustrates 

25 that the per unit cost of production of power is significantly 
higher for power output below a level of about 1 60 MW than 
for power above such level. Cost peaks are associated with 
all increases in power output. The goal of optimization is to 
characterize the manner of increasing power output which 

30 minimizes the cost per net MW. From FIG. 6B, it is apparent 
that a potential source of savings is associated with tran- 
sients during load shifting, and especially during ramping. 
Thus, the system focuses on transient behavior and charac- 
terizes the manner of increasing output which employs the 

35 least energy. FIG. 6C shows the accumulation of selected 
transients from the raw data 16. Such selection of transients 
may be conducted manually by an operator or automatically, 
using pattern recognition algorithms. The selected transients 
are preferably combined and presented to the representation 

40 subsystem 104. 

The process of incorporating the data 16 into a consistent 
representation is controlled by the representation subsystem 
104. The representation subsystem 104 abstracts the data 16 
into a multiresolutional representation by consecutive 

45 bottom-up multivariable clustering (generalization). Refer- 
ring now to FIGS. 7A-7C, in the case of the power plant 
example, the state-space has only three dimensions and is 
given a tangible graphic interpretation. In FIG. 7A, the entire 
space of practical operation (the work space) for the power 

50 unit 170 is shown. The axes are power 200, pressure 202 and 
temperature 204. The thermodynamic variables of pressure 
and temperature provide sufficient indicators of process 
dynamics to generate a first approximation. Pressure is 
measured at the turbine throttle and temperature at a pre- 
ss ceding measurement stage. Individual points 206 within the 
space represent a label or marker to a distinct range of 
operating points. A range of operating points (per marker) is 
associated with the respective marker, using the measure of 
indistinguishability at a particular resolution level. For the 

60 first resolution level (FIG. 7A), each point represents a range 
of power output of about 35 MW, 1350 psi, and 6° F. The 
points actually form a cloud which is depicted as a grid in 
order to simplify the presentation of the results. The lines or 
edges 208 connecting the points 206 in the grid mark the 

65 existence of stored information about ways of moving from 
one operating point 206 to another operating point 206 at the 
level of resolution (and their costs). This information is 
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stored with the limited precision of this rough level of optimum which is expected to yield a more precise result at 

resolution. The purpose of this information is to delineate a the next level of resolution. The refinement is continued 

region of the space on which to focus while examining a until an acceptable degree of precision is attained. The total 

particular range in the power output level 184. FIG. 7A number of levels in a multiresolutional hierarchy is deter- 

illustrates only a limited amount of information since it is 5 mined by the overall space of interest at the lowest level of 

drawn from only a few days of operation. However, it will resolution, by the final accuracy at the highest level of 

be apparent to those of ordinary skill in the art that much resolution, and by the condition of minimizing computa- 

greater amounts of information can be handled by the tional complexity. The search results at the third level of 

present invention. resolution are shown in FIG. 8B. FIG. 8B is a three - 

The acquisition and storage of the data 16 may be 10 dimensional plot which superimposes the optimal state 

performed either automatically and/or manually and also trajectory for an output transition from 90 MW-400 MW on 

may be performed either off-line and/or on-line. An impor- the data 16. 

tant feature of the present invention is the ability to auto- FIGS. 9A and 9B are two-dimensional plots (i.e. a decom- 

matically integrate information while monitoring a process position of FIG. 8B) of the power 200 against the pressure 

on-line. The automation of the preprocessing subsystem 104 15 202, and the temperature 204, respectively. FIGS. 9 A and 9B 

and the structure of the constructed model allows the updat- are shown in order to provide a more intuitive feeling for the 

ing of information whenever changes in system behavior suggested strategy. FIGS. 9A and 9B show the optimal 

become apparent. FIGS. 7B and 7C show subsets of the pressure-power plot and temperature-power plot, 

space at increasing resolution. In general, having collected respectively, for a cycle of output change from 90 MW-400 

huge amounts of data, it is not computationally feasible to 20 MW and back down to 90 MW and illustrates how param- 

study the whole space when looking for particular optimal eters and variables should move to maximize unit 170 

paths. Accordingly, the preprocessing subsystem 102 pref- efficiency. The approximate cost of the suggested path 

erably includes an algorithm for pruning the space before during ramp-up is about 110 MBTU-hr. From FIG. 9Aand 

proceeding at higher resolution levels constructing the enve- FIG. 9B, it is clear that the suggested strategy allows 

lope for the subsequent search). In the general case, the 25 (acceptable) fluctuations in steam temperature, and imposes 

number of variables studied as a group is often larger than a linear relationship between pressure 202 and power 200 in 

three. The functioning of the present invention is not all but the initial stages of an increase in the power output 

affected by this fact, however, the convenient graphical 184. 

symbolism is lost. Of course, groups of three or less van- The envelope creation algorithm, which is also used for 

ables may still be viewed at the same time. The purpose of 30 selecting a subset of the space for further refinement during 

FIGS. 7A-7C is only to provide a clear and tangible transitions from lower to higher resolution, provides data on 

interpretation of the approach used by the present invention. other strategies attempted during the same increase of out- 

Between the first and third levels of resolution (FIGS. 7A put. According to this information, the process of ramping 

and 7C), the tessellation sizes are halved between levels of the power generating unit 170 should be more uniform and 

resolution, such that the spatial density of the tessella 35 closer to the optimal curves suggested. Accordingly, the 

increases four times between FIGS. 7A and 7C. control signals 114 generated by the planning subsystem 106 

The purpose of constructing the multiresolutional attempt to control the unit 170 in order to make the ramping 

representation, in general, is to allow the efficient use of up process more uniform. Additional data may be used to 

search at the initial level for the optimal strategy for making make this analysis more comprehensive and accurate (with 

the operating point low resolution transitions required dur- 40 additional levels of representation which are inappropriate 

ing normal operation of the power generating unit 170, without the corresponding data). 

followed by the selection of a subset of the representation at FIG. 10 shows the suggested heat input 214 required (in 
the next level for more refined search. If this strategy is not terms of BTU) for following the optimal trajectories deter- 
implemented, the number of points which must be searched mined by the control system. The heat input 214 is shown in 
for an adequately precise solution is prohibitive. The plan- 45 terms of BTU and is plotted against power output. Using 
ning subsystem 106 performs a search at several levels of known fuel cost information, such as the cost of oil or gas, 
resolution before arriving at a solution (optimal trajectory) specific oil and/or gas flow rates may be calculated to 
of appropriate accuracy. A variation on Dijkstra's search determine the efficiency of the unit 170. 
algorithm, as previously discussed, is applied to the distrib- From the foregoing description, it can be seen that the 
uted graph representation (FIGS. 7A-7C) to determine opti- 50 present invention comprises a multiresolutional decision 
mal strategies of control. support system for multiresolutional analysis of data from 
FIG. 8A shows the results of searching for a single diverse sources or subsystems to formulate plans or rules of 
solution trajectory 210 at the first level of resolution and system operation which enhance system performance. The 
FIG. 8B shows the results 212 for searching for a single foregoing describes the application of multiresolutional 
solution trajectory at the third level of resolution. The 55 analysis techniques to an operating power plant. However, 
objective of the analysis is to find the most fuel efficient way the principles disclosed herein, e.g., data structuring and 
of changing the operating point of the unit 170 from that organizing, selective parameter lumping and search-based 
corresponding to an output of 90 MW to one corresponding optimization methods can be applied to any system or 
to an output of 400 MW. The throttle pressure change process possessing the attribute of semiotic variables which 
corresponding to a change in the power output 184 is from 60 result in a multiresolutional array of information. That is, 
1000 psi to 2400 psi and the temperature change is from other process systems, such as those found in fabricating 
990° F. to 1000° F. The variation on the standard search plants, chemical facilities, refineries, and the like, can ben- 
algorithm is designed to allow the examination of sub- efit in similar fashion to the analysis and modeling tech- 
optimal paths, which results in the ability to determine a niques described herein. The present invention is also useful 
locus of paths whose costs differ from an optimum (at the 65 for a number of other systems and activities which have not 
current level) by an amount that is less than an assigned been previously recognized as possessing semiotic charac- 
threshold. This locus is used to select an envelope around the teristics and which cannot be adequately modeled 
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mathematically, such as assembly, packaging and warehous- 
ing facilities and mission definition and analysis. It will be 
recognized by those skilled in the art that changes may be 
made to the above- described invention without departing 
from the broad inventive concepts thereof. It is understood, 
therefore, that this invention is not limited to the particular 
embodiment disclosed, but is intended to cover any modi- 
fications which are within the scope and spirit of the 
invention as defined by the appended claims. 
What is claimed is: 

1. In a power plant, a planning and control system for 
determining output trajectories of a predefined output behav- 
ior and input control commands for achieving the predefined 
output behavior, the system comprising: 

(a) means for acquiring data related to at least one process 
variable of the power plant; 

(b) means for organizing the acquired data and generating 
at least one state input-output string therefrom; 

(c) means for fusing the strings into associative clusters, 
the clusters forming a function oriented, goal- 
independent provisional model of the power plant; 

(d) means for generating a multiresolulional data structure 
based upon the associative data clusters for transform- 
ing the provisional model into at least one level of 
resolution incorporating embedded local dynamics of 
the power plant; 

(e) means for searching the multiresolutional data struc- 
ture at varying levels of resolution to determine an 
optimal trajectory of operation for achieving the pre- 
defined output behavior; and 

(f) means for generating control signals for controlling at 
least one operational variable of the power plant such 
that the power plant operates according to the optimal 
trajectory. 

2. The system of claim 1 wherein the data is acquired 
on-line and the search is conducted off-line. 
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3. In a power plant, a method for determining output 
trajectories of a predefined output behavior and input control 
commands for achieving the predefined output behavior, the 
method comprising the steps of: 

(a) acquiring data related to at least one process variable 
of the power plant; 

(b) organizing the acquired data and generating at least 
one state input-output string therefrom; 

10 (c) fusing the strings into associative clusters, the clusters 
forming a function oriented, goal -independent provi- 
sional model of the power plant; 

(d) generating a multiresolutional data structure based 
25 upon the associative data clusters for transforming the 

provisional model into at least one level of resolution 
incorporating embedded local dynamics of the power 
plant; 

(e) recursively searching the multiresolutional data struc- 
20 ture at varying levels of resolution to determine an 

optimal trajectory of operation for achieving the pre- 
defined output behavior; and 

(f) generating control signals for controlling at least one 
25 operational variable of the power plant such that the 

power plant operates according to the optimal trajec- 
tory. 

4. The method of claim 3 wherein step (e) further com- 
prises synthesizing optimal trajectories of process operation 

30 using a search applied to the multiresolutional data structure 
at successively higher levels of resolution with subsequent 
propagation of the search results to successively lower levels 
of resolution. 

5. The method of claim 3 wherein the data is acquired 
35 on-line and the search is conducted off-line. 

* * * * * 
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ABSTRACT 



Methods, systems, and computer program products for 
facilitating user choices among complex alternatives utilize 
conjoint analysis to simplify choices to be made by the user. 
A selector tool presents a user with a first and second series 
of choices relating to attributes of products or services 
available to the user. A utilities calculation engine calculates 
the relative utility of each of the products or services to the 
user and presents output to the user, which indicates the 
relative utility of each of the products or services. The user 
can then select the product or service that has the highest 
utility value for the user based on the calculated relative 
utility values. 
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SelectorTooI 

Step 1 - Attribute Selection 



Please check which ofth# following attributes (characteristics) are important to you when making a health care 
plan choice. You nay select v many u you would like (the mote you select, the longer the exercise will tiki to 
be certain to chooee those attributes that ere important to you). Hawevet; there tenet be el least 4 attributei 
checked for the tool to work. As you willnote, •Monthly Employee Contribution" is already checked for you 
since our mi arch hw found thetiiucuetypleyeeaiii^oitentioleineny health cere plan selection. 

To set the definition of any attribute listed, simply click on the attribute and you wiQbt presented with its 
definition. 

For a more detailed explanation of how the tod woiki eee flowtha Selector Tool y/prkjS - 



Separate per admusion hoipiUI deductible 



In-palienthosoftal servicea coveraga 



Your cort per doctor's office visit 



Your cortpet ipacjalirttiitt 



Your cot per 



ft«sflfrtjoftofrg coverage. 
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FIG. 4 
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Selector Tool 

Step 2 - Importance of Difference Ratings 



You win now be presented with a serial of "importenee of difference" ruling questions, on* for itch of the 
attribute ■ you selected as important m the prrviouf step . You will be presented with two hypothetical vahia s 
that 4 plan could poss tf s for each attribute: a high value and alow vah». Using the scale provided, rate how 
important the difference is to you between these two possible levels. You can rata the importance of the 
difference "extremely important" (on the lefty, "not important" (on the right) or anywhere in between. 

You must provide & response for every question prior to moving onto the next step. 

To 9*9 the definition, of my ittribuijj lilted, simply dick on the attribute end you will be presented with its 
definition. 

For a more detailed explanation of how the tool works see H ow the Selector To ol Work* . 



How important is the difference between apian with..,.. 



An employee contribution of $38£0per 
month. 



An employee contribution of $9003 per 

month 
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SelectorTooI 

Step 3 - Trade-Off Questions 

You wiU now be presented with t series of "trede-oflF questions. We uk you to choose between two 
hypothetical eiU of attribute values (in boies), e ach with e high value of one attribute paired with alow Tehie of 
mother attribute. Compere your preference between these two nU of attribute pairing*. Then, using the rating 
•c ale prodded, rat* the degree of preference you hive between the two seta. If you prefer the right tt% you 
would rate towaar de the right tide of the eetle. If you prefer the left eat, you would rate towarde the left tide of 
the i eale (ox, if you have hUie preference, you would rate towards the middle of the scale). 

You mutt provide a response for every question prior to moving onto the next step. 

To see the definition of any attribute listed, simply dick on it end you wiU be presented with its definition. 

For a more detailed explanation of how the tool works see How the, SriMtW Tori Wort? 



WHrkdejeuprefcr? Aplamvbk-. 



An annual deductible of $Oj00. 
AND 

An employee contribution of $90 UQ per 



An annual deductible of $500.00. 
AND 

An employee contribution of $38.00 per 
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plea shorn you how weH etch plan matches your personal health plan importance ptq3«, based on your 
responses. The larger the toe of the importance indicator bar, the better the plan fit* your importance profile. 

Fiorahtre, continue on to Compare Your Plans. There, you cm s elect from the verioua pleni end directly 
c omp ve their attribute details side by side. In addition, you can check the NCOA Accreditation status for each 
plan. 

For a more detailed explanation of how the tool works see ft 



Selector Tool 
Results 

The plans listed below are those available to you for 3001. The ^ 
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998 PSCTastPlanl 



* Dicplayt the plans available to yon illative to how weB each matches yoor stated preference*, ia deceadingorder 

s prist bvrteB is iriRt this ft r htm reference. Tear data will >et be smci afler yarn ckse 
IdrrJeaaffr, ftr •scmrirj afthk ImftrttttUm, W sire to elace yawr trawser wkei yent an sVne 
^tafiflaai the HeahkCare 2001 Website. 



Dbe the b 

yaur browser. MtOuuJfy, i 
bMkiMf alilaneb 



Do you have a moment to help us? The information you provide will remain confidential and help us tmpravv the 
lite. Flew hate us bv answering 3 Quick Questions. 
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Compare Your Plans Results 



Below is stable of plan details but don your request Flan inform tb'rm is otgenaed by ceiegory: Costs, 
Benefits, Access and Satisfaction. Within ewh attribute you will see the attribute torn. To seethe definition of i 
tem limply click on the teak. 

Attributes highlighted myeflow represent those eitributes thet you indie ited as important during the Selector 
Tool exercise (if you henrt goo* through the Selector Too$. 

Below it tUble of pita deteuf bued on your request Pitt iofoaneiioa is organized by c tie gory: Costs, 
Benefits, Access endSensfictirja. Within each attribute you wilt see the attribute tem To see the definition oft 
tem limply click on the terra. 
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adnussjoa20 




[ivptliettthDspHeJ services 
cpyeras;q 


bvpeitiKd hospital sejvices 

coveiajj 90% 


In-patient hospital services ' 
covers© 100% 




four cdsI per doctor's offici 
visit 


An out-of-pocket cost for tPCP 
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An oni-of-pocket cost for a 
specialist of $20 
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specialist of $20 




visit 
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en»nfencyioom visit of $15 
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emergency room visit of $20 




prescription 
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METHODS, SYSTEMS, AND COMPUTER pier decisions. "Alternatives" in this context can be products 

PROGRAM PRODUCTS FOR FACILITATING (such as automobiles), services (such as health plans), 

USER CHOICES AMONG COMPLEX combinations of complementary services and products, or 

ALTERNATIVES USING CONJOINT virtually anything else individuals must decide to choose or 

ANALYSIS 5 not cjjQQgg Complex "alternatives" are those defined in 

terms of many "variables" such that in the decision process 

TECHNICAL FIELD a * ot °^ m f° rmat i° 11 must De considered. Complex "alterna- 
tives" often create difficult decisions that demand that the 
The present invention relates to using a proven social 1Q chooser trade-off the good and bad in each "alternative." For 

science statistical technique called conjoint analysis to example, the choice between a high-quality bicycle versus a 

facilitate choices among complex alternatives More low . qualit y bicycle, given quality is the only criterion used 

particularly, the present invention relates to methods, sys- m ^ ^ fc m Qne Ho ^ ^ 

terns and computer program products for facilitating mdi- becQme mQre j ^ choice becQmes mofe 

vidual user choices among complex alternatives using a 1C , , , ~ ; . j ^n. u - u uu 
j 4 r • • * i ■ 15 an " trade-offs must be made. The choice between a high- 
unique adaptation of conjoint analysis. . u .... , . . . t . . t & 

quality, $500 bicycle that comes in pink only versus a 

BACKGROUND ART low-quality, $100 bicycle that comes in either green, black, 

or blue is a more difficult decision than that based on quality 

As a research methodology, conjoint analysis has been in on i v> 

use in the academic and commercial research community for 20 

many years (since the mid-1 970's), and has been commonly present invention uses, at its core, an adaptation of the 

used for marketing research purposes to assess consumer conjoint model decision process. The use of the conjoint 

preferences among competing products or services. exercise allows to the tool to assist users in making difficult 

Generally, conjoint analysis is a tool that researchers use decisions less complex. By going through the exercise, 

to estimate the relative importance of the attributes that 25 unique profiles of what is important to the user are devel- 

comprise the "alternatives" in the "choice set" and how oped by the application. 

much utility each "setting" of each "attribute" has for In addition tQ developing ^ files> the t 

mdividuals. Results are often used to simulate the effect on invention> at the end of ^ exerd ^ ^ ^ a 

market snare that various changes m the attribute settings „ ,.. fC .„ CL „ . , 

. , . fi , „ .. M/ -j 4-p Tu 30 quality of fit* measure of how well each product or service 

have and thus to fine tune alternatives (e.g. identify the JU ^ /. ± . J, 

, . t ^\ j ♦ .p * i * 1 available to them meets their unique profile, 

optimal price for a product) and to forecast market share. ^ * 

While many forms of conjoint analysis exist, there are two In order to facilitate user choices among complex 

general defining properties of any conjoint process: 1) each alternatives, the present invention includes computer soft- 

at some point gathers data from individuals by asking each ware that requires an individual user to go through a series 

individual to consider (the "con" in conjoint) two or more 35 0 f less complex choices. The software first presents the user 

variables simultaneously or jointly (the "joint" in conjoint) ^ a ^ of features. The user selects features which are of 

and 2) each uses the gathered data (responses) to estimate importance to the user. The software then presents the user 

how much utility or value each "attribute setting." Typically, with a ^ series of choices requiring the ^ t0 m t or 

conjoint data is gathered from a sample of users and then select &st ^ ^ Mq ^ rtance of a best 

analyzed with no flow of mformation back to the user. Thus, w ... « nr . ... c u*.u i*j«* 

a. 3 . , t eu ac i- *• *u * • • settmg and a worst setting of each of the selected features, 

there exists a long-felt need for applications that use conjoint ^ 6 . 4 , . j ^ . • c • - 

analysis to facilitate individual nser choices among complex ™ e user » then P resented a "™* °f chorees 

decisions by providing conjoint analysis results back to the squiring the user t0 ln P u < ° r ^ values Seating 

user the relative importance of the user s preference between first 

For example, this need is particularly acute in the area of 45 ^ ^JTf of Jj» sel f ed attributes. Each pairing 
employer-sponsored health plans. Many large- and medium- mcl " des a b f SQi ^ °\ on& attnb * te and a worst of 
sized employers offer a number of health plan options for another attnbute ' ^ values in P ut b ? the *" T in me second 
employees. Each health plan includes various features, such senes of choices m nterpreted as the mathematical differ- 
as monthly premium, annual deductible, prescription drug ence e <l ual t0 the relative importance of a best and worst 
coverage, etc. Due to the number of plans and the number of 50 settin g of one attribute minus the relative importance of a 
different features of each plan, the choice between plans best a worst setting for the other attribute in the pairing, 
becomes difficult for the individual employee. Moreover, the A final importance value is calculated for each of the 
employer typically cannot advise an employee to choose one attributes based on the initial relative importance values in 
plan over the other because the employer can be held liable the first series of choices and the mathematical difference 
if the employer advises an employee to choose a plan that values. Products and services available to the user are rated 
does not pay for some of the employee's medical expenses. based on the final importance values. The user is then 
Accordingly, in the employer-sponsored health plan selec- presented with data indicating the relative utility to the user 
tion process, there exists a long-felt need for methods and 0 f each of the products or services, 
systems for facilitating employee choices among health 
plans. 
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Terminology 



DISCLOSURE OF THE INVENTION 



Before proceeding, a review of keywords and key phrases 
According to one aspect, the present invention includes a anQl their definitions used in this document is warranted, 
software tool that embodies a "conjoint" model decision 65 These keywords are placed in double quotes throughout the 
process permitting the simplification of difficult choices document to indicate their use may be somewhat different 
among complex alternatives into a sequence of short, sim- from common use. 
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Keyword or Key Phrase Definition 



"user" 



"alternative" 



"choice set" 



"attribute" 



"setting" (or 
setting") 



'attribute 



"importance" 



"difference in 
importance" 



"final computed 
importance" 
"setting utility" 
(or "attribute 
setting utility") 



"total utility" 



A person going through the software < 
to gain help in making a choice 
A single product or service (among a set of 
products or services) the "user" can potentially 
choose 

All the "alternatives" the "user" is eligible to 
choose from 

One of numerous variables, each defined as 
the continuum between its worst "setting" and 
best "setting," used to define the "alternatives" 
The value a particular hypothetical or actual 
"alternative" has for a particular "attribute"; the 
hypothetical "alternatives" studied during the 
data-gathering phase of the algorithm are all 
specified in terms of the worst "setting" vs the 
best "setting" for each "attribute," whereas 
actual "alternatives" available to the "user" 
may be specified by "settings" anywhere 
along each "attribute's" continuum 
A measure that the user gives directly via the 
importance-of-the-difference (between worst 
and best "settings") screens of the relative 
importance of a single "attribute" 
A measure that the user gives directly via the 
trade-off screens of the (mathematical) 
difference in the "importance" of two 
"attributes" 

A final estimate of the true relative importance 

of an "attribute" to a "user" 

The relative (relative to al! "attribute settings") 

worth or utility of a particular 

"attribute setting" 

(anywhere along the "attribute" continuum) to 
a particular "user"* 

The total relative (relative to all "alternatives" 
available to that user) worth or utility of a 
particular "alternative"; defined as the simple 
sum across "attributes" of the "setting utilities" 



To ensure these keywords and phases are understood, the 
following example is given. 

A person is trying to make a choice between a medium- 
quality bicycle priced at $250 and a high-quality bicycle 
priced at $375. The person is given a tool that assists the 
person in the selection. The tool requires the person to state 
on a l-to-5 scale the relative importance of quality and price. 
For purposes of this example, it is assumed that the person 
selects 5 and 4, respectively. The values "5" and "4" are 
"importance" measures as defined above. The tool also asks 
the person to rate to what degree the person would prefer a 
high-quality, $500 bicycle to a low-quality, $100 bicycle. In 
this example, it is assumed that the person indicates a 
preference for the higher quality, more expensive bicycle, a 
"+1" on a -4-to-+4 scale. The value +1 is a "difference in 
importance" value as defined above. The tool then computes 
that the true importance (on a l-to-5 scale) of quality and 
price for this person is a 4.7 and a 4.1, respectively. The 
values 4.7 and 4.1 are "final computed importance" values, 
as defined above. These values are used in turn to compute 
that high-quality is worth 25 (unitless) points to the person 
whereas medium quality is worth 15 points. The values "15" 
and "25" are "setting utilities" for the quality and price 
attributes. Similarly, the tool computes that $250 is worth 15 
points to the person and $375 is worth 10. Thus, the tool 
computes that the total worth of the medium-quality bicycle 
priced at $250 is 30 points (15+15) and that the total worth 
of the high-quality bicycle priced at $375 is 35 points 
(25+10). The 30 and 35 point values are "total utility" values 
as defined above. Because 35 is higher than 30, the tool has 
computed that the medium-quality bicycle priced at $250 is 



10 



worth slightly less to the person, all things considered, than 
the high-quality bicycle priced at $375. Thus, the tool 
recommends that the person should choose the high-quality 
bicycle priced at $375. The following table provides a 
summary of examples of each keyword or key phrase from 
the above example. 



Keyword or Key Phrase Example 



15 



20 



"user" 

"alternative" 



"choice set" 



25 



30 



35 



"attribute" 
"setting" (or 
"attribute setting") 
"importance" 
"difference in 
importance" 
"final computed 
importance" 
"setting utility" 
(or "attribute 
setting utility") 
"total utility" 



The person shopping for a bicycle 
The medium-quality bicycle priced at $250 
and the high-quality bicycle priced at $375 are 
the actual "alternatives"; the high-quality, $500 
bicycle and the low-quality, $100 bicycle are 
the hypothetical "alternatives" used in the 
data-gathering phase 

The medium-quality bicycle priced at $250 
and the high-quality bicycle priced at $375 
together form the actual choice set for the 
"user'*; the high-quality, $500 bicycle and the 
low-quality, $100 bicycle form a hypothetical 
"choice set" to which the "user" is asked to 
react. 

Quality is an "attribute" as is price 

$375 is an actual "setting" of price; $100 is a 

hypothetical "setting" for price 

The "5" given for quality 

The "+1" 

The "4.7' for quality 

The "25" for the high-quality 
"setting" of quality 

The "30" for the medium-quality bicycle priced 
at $250 "alternative" 



55 



60 



65 



One goal in developing the present invention was two- 
fold. First, create an adaptation of conjoint that is as user 
friendly as possible (keep it short and easy to understand). 
Second, go beyond the end of traditional conjoint 
(developing "utilities") and apply these utilities to the per- 
formance of a set of products, presenting the user with a 
sorted list of how well each product meets their stated 
preferences. In adapting a research statistical technique, 
traditionally used to study group preferences, and using it to 
match individual consumer preferences to actual products or 
services, the present invention application has established a 
highly useful product in the marketplace. 

As mentioned above, conjoint has been in use since the 
1970's. While there are a variety of implementations of the 
conjoint algorithm in the market the design chosen for 
implementation of the present invention is exceptionally 
simple, and yet robust. In addition, the way the present 
invention has been developed makes it unique. For example, 
features of real products are evaluated and levels are created, 
so that all products can be compared by the application in a 
purely objective basis. The feature attribute descriptions are 
made as simple and as straightforward as possible. In 
addition, after the user completes the process of selecting 
attributes features of the product, making importance of 
difference decisions, and then trade-off decisions, the appli- 
cation presents results to the user in very simple bar-chart 
form. The application shows all products available to the 
user in priority order, based on how well each product 
matches the preference utility of that individual. 

The algorithm utilized by the present invention is unique, 
in that it provides for paired trade-offs (two by two com- 
parisons of end-point "attribute" characteristics) instead of 
the usual more complicated trade-offs involving more than 
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two "attributes" defined not only by their end-points (best businesses and consumers to choose energy companies, 

and worst "settings") but by numerous "settings" along their There are many other uses of this application currently being 

entire continuum. As used herein, the term "endpoints" planned, 
refers to the best and worst settings of an attribute. For 

example, in the bicycle example discussed above, $100 and 5 BRIEF DESCRIPTION OF THE DRAWINGS 

$500 are endpoints for the price attribute; whereas "high" Pre f err ed embodiments of the invention will now be 

and "low" are endpoints for the quality attribute. ^ explained with reference to the accompanying drawings, of 

According to another aspect of the invention, an "X" which: 

matrix utilized to estimate "attribute" "utilities". An "X nG x fe , block am mustrating m exemplary 

matnx-.asdescnbedherem.isa configuratron of explana- ti environments for embodiments of the present 

tory variable data, or numbers, in a mathematical format. invention- 

The "X matrix" designates the independent variable values ' . 

usedintheordinaryi;astsquaresmatrixset,whereasthe"Y ^ 2 * * dl ^ m f * * Sete ?? r ^ *™ 

Matrix" designates the dependent variable values. Examples according to an embodiment of the present invention; 

of X and Y matrices and their use in calculating utilities for * 5 FIG. 3 is a block diagram illustrating the relationship 

attributes will be discussed in more detail below. between screens presented to the user by the selector tool 

Yet another aspect of the invention is the way in which the server according to an embodiment of the present invention; 

results of a user's interaction with the tool are "fed back" to FIG. 4 is a screen shot of attribute selection page 302 

the user. For example, each individual's alternative choices illustrated in FIG. 3; 

of products, services or concepts are ranked in declining 20 FIG. 5 is a screen shot of importance page 304 illustrated 

order of "total utility." This way of "reporting" back to each in FIG. 3; 

user on how their priorities and decision criteria "value" $iq 6 is a screen shot of paired trade-off page 306 

each alternative clearly indicate the "best fir" choices among illustrated in FIG. 3; 

all the alternatives in an individual's "choice set." ^ prG ? fc a shot of results page m ill^trated in 

While one use of the present invention is "attribute" pjQ 3. 

preference-based decision support tool, the software also nG ' g fc a shot of 31Q mustrated m 

simultaneously creates databases of user-level "preference p IQ 3. ^ 

data" (i.e. "final computed importance" and "setting utility" _ ' . 

data) and other descriptive data. This data has value in the 3Q HQ. 9 15 a block diagram of a layered se ector tool server 
marketplace to producers and middleman organizations as 30 according to an embodiment of the present invention, 
conjoint research and can be used for developing analyses of DETAILED DESCRIPTION OF THE 
market share "attribute" importance, and other outcomes of INVENTION 
the decision-making process. The creation and merchandiz- 
ing of this data is very much a fundamental aspect of the 35 Overview 
tool's value. 

Currently, the focus of use for the present invention is in A method for facilitating user choices among complex 

the selection of health plans by consumers or employees of alternatives according to an embodiment of the present 

medium-sized or large employers. The fringe benefits of invention is comprised of three mam steps followed by 

most employers of any size typically include health care 40 ^sults and detailed product comparisons. Each of these 

financing, and it is not unusual to find medium and large steps through the exercise are mteracUve-that is they 

employers offering 3, 4 or more health plans to its employ- engage the "user" and require the "user s' input. In addition 

ees An employee of those companies uses the present each ste P rehes on the P"™» st ?P' How ^ JW 

invention to help him/her select that plan from among the responds in one step will affect what the user is asked to do 

alternatives offered which is best suited to him/her. As 45 m subse <l uent ste P s - M ead of these ste P s *» 15 

discussed above, employees are left by their employers to provided with results, 

their own resources in selecting a health plan. The major The main components of the tool are: 

barrier to a more activist policy by employers is one of 1. "Attribute" Selection — branded on the site displayed as 

liability for employee choices. Another barrier is an eco- "Attribute Selection" 

nomic one since uncertain employees commonly consume 50 2. "Importance" Ratings— branded on the site displayed 

huge amounts of human resources staffer time seeking ^ "importance of Difference" 

guidance in making their choices among health plans. Left 3 « Difference m i mpor ta n ce" Ratings-branded on the 

to their own devices, employees wiU seek advice from other ^ ^ as « Trade „ ofife » 

employees or may select a plan based on one or a lew 

criteria — such as premium cost, type of plan or perhaps two 55 4 * Results 

or three features of a plan. The present invention alleviates 5. Detailed "Alternative" Comparisons 

these problems by applying conjoint analysis to facilitate Software for implementing each of these steps will be 

user choices among a large array of complex alternatives. discussed in more detail below following a discussion of the 

While the present invention is suitable for assisting operating environment for the software, 

employees choose health plans, it has been developed to be 60 Exemplary Operating Environment 

generic/flexible enough to be applied to any complex deci- r / r 

sion. For example, the algorithms described herein are Turning to the drawings, wherein like reference numerals 

suitable for facilitating user choices among a variety of refer to like elements, the invention is illustrated as being 

complex alternative, supplemental insurance, 401k plans/ implemented in a suitable computing environment, 

mutual funds, and other product or service categories. Pro- 65 Although not required, the invention will be described in the 

totypes of this application have been developed, for general context of computer-executable instructions, such as 

instance, to assist consumers in choosing computers, and program modules, being executed by a personal computer. 
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Generally, program modules include routines, programs, computers typically include other peripheral output devices, 
objects, components, data structures, etc. that perform par- not shown, such as speakers and printers. With regard to the 
ticular tasks or implement particular abstract data types. present invention, the user may use one of the input devices 
Moreover, those skilled in the art will appreciate that the to input data indicating the user's preference between alter- 
invention may be practiced with other computer system 5 natives presented to the user via monitor 47. 
configurations, including hand-held devices, multi- The personal computer 20 may operate in a networked 
processor systems, microprocessor based or programmable environment using logical connections to one or more 
consumer electronics, network PCs, minicomputers, main- remote computers, such as a remote computer 49. The 
frame computers, and the like. The invention may also be remote computer 49 may be another personal computer, a 
practiced in distributed computing environments where JQ server, a router, a network PC, a peer device or other 
tasks are performed by remote processing devices that are common network node, and typically includes many or all of 
linked through a communications network. In a distributed the elements described above relative to the personal corn- 
computing environment, program modules may be located puter 20, although only a memory storage device 50 has 
in both local and remote memory storage devices. been illustrated in FIG. 1. The logical connections depicted 
With reference to FIG. 1, an exemplary system for imple- 15 in FIG. 1 include a local area network (LAN) 51, a wide area 
menting the invention includes a general purpose computing network (WAN) 52, and a system area network (SAN) 53. 
device in the form of a conventional personal computer 20, Local- and wide-area networking environments are corn- 
including a processing unit 21, a system memory 22, and a monplace in offices, enterprise-wide computer networks, 
system bus 23 that couples various system components intranets and the Internet. 

including the system memory to the processing unit 21. The 20 System area networking environments are used to inter- 
system bus 23 may be any of several types of bus structures connect nodes within a distributed computing system, such 
including a memory bus or memory controller, a peripheral as a cluster. For example, in the illustrated embodiment, the 
bus, and a local bus using any of a variety of bus architec- personal computer 20 may comprise a first node in a cluster 
tures. The system memory includes read only memory and the remote computer 49 may comprise a second node in 
(ROM) 24 and random access memory (RAM) 25. A basic ^ the cluster. In such an environment, it is preferable that the 
input/output system (BIOS) 26, containing the basic routines personal computer 20 and the remote computer 49 be under 
that help to transfer information between elements within a common administrative domain. Thus, although the com- 
the personal computer 20, such as during start-up, is stored puter 49 is labeled "remote", the computer 49 may be in 
in ROM 24. The personal computer 20 further includes a close physical proximity to the personal computer 20. 
hard disk drive 27 for reading from and writing to a hard 30 When used in a LAN or SAN networking environment, 
disk, not shown, a magnetic disk drive 28 for reading from the personal computer 20 is connected to the local network 
or writing to a removable magnetic disk 29, and an optical 51 or system network 53 through the network interface 
disk drive 30 for reading from or writing to a removable adapters 54 and 54A. The network interface adapters 54 and 
optical disk 31 such as a CD ROM or other optical media. 54A may include processing units 55 and 55A and one or 

The hard disk drive 27, magnetic disk drive 28, and 35 more memory units 56 and 56A. 

optical disk drive 30 are connected to the system bus 23 by When used in a WAN networking environment, the per- 

a hard disk drive interface 32, a magnetic disk drive inter- sonal computer 20 typically includes a modem 58 or other 

face 33, and an optical disk drive interface 34, respectively. means for establishing communications over the WAN 52. 

The drives and their associated computer-readable media The modem 58, which may be internal or external, is 

provide nonvolatile storage of computer readable 40 connected to the system bus 23 via the serial port interface 

instructions, data structures, program modules and other 46. In a networked environment, program modules depicted 

data for the personal computer 20. Although the exemplary relative to the personal computer 20, or portions thereof, 

environment described herein employs a hard disk, a remov- may be stored in the remote memory storage device. It will 

able magnetic disk 29, and a removable optical disk 31, it be appreciated that the network connections shown are 

will be appreciated by those skilled in the art that other types 45 exemplary and other means of establishing a communica- 

of computer readable media which can store data that is tions link between the computers may be used, 

accessible by a computer, such as magnetic cassettes, flash \ n the description that follows, the invention will be 

memory cards, digital video disks, Bernoulli cartridges, described with reference to acts and symbolic representa- 

random access memories, read only memories, and the like tions of operations that are performed by one or more 

may also be used in the exemplary operating environment. 50 computers, unless indicated otherwise. As such, it will be 

A number of program modules may be stored on the hard understood that such acts and operations, which are at times 

disk, magnetic disk 29, optical disk 31, ROM 24 or RAM 25, referred to as being computer-executed, include the manipu- 

including an operating system 35, one or more applications lation by the processing unit of the computer and/or the 

programs 36, other program modules 37, and program data processing units of I/O devices of electrical signals repre- 

38. 55 senting data in a structured form. This manipulation trans- 

A user may enter commands and information into the forms the data or maintains it at locations in the memory 

personal computer 20 through input devices such as a system of the computer and/or the memory systems of I/O 

keyboard 40 and a pointing device 42. Other input devices devices, which reconfigures or otherwise alters the operation 

(not shown) may include a microphone, touch panel, of the computer and/or the I/O devices in a manner well 

joystick, game pad, satellite dish, scanner, or the like. These 60 understood by those skilled in the art. The data structures 

and other input devices are often connected to the processing where data is maintained are physical locations of the 

unit 21 through a serial port interface 46 that is coupled to memory that have particular properties defined by the format 

the system bus, but may be connected by other interfaces, of the data. However, while the invention is being described 

such as a parallel port, game port or a universal serial bus in the foregoing context, it is not meant to be limiting as 

(USB). A monitor 47 or other type of display device is also 65 those of skill in the art will appreciate that the acts and 

connected to the system bus 23 via an interface, such as a operations described hereinafter may also be implemented in 

video adapter 48. In addition to the monitor, personal hardware. 
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In FIG. 1, exemplary application programs 36 used to important to describing the invention, further description 

implement the present invention include a selector tool relating thereto will not be presented herein, 

server 36 A implemented on local computer 20 and a selector Attribute selection page 302 provides a listing of 

tool client 36B implemented on remote computer 49. Selec- attributes, allows the user to select attributes that are of 

tor tool server 36A may communicate with selector tool 5 importance to the user, and links each attribute to terms to 

client 36B over local area network 51, system area network know. FIG. 4 is a screen shot of an exemplary attribute 

53, or wide area network 52. Exemplary communication selection page 302. In FIG. 4, attribute selection page 302 

protocols that may be used for communication between includes an instruction portion 400 that provides the user 

selector tool server 36A and selec tor tool client 36B over with instructions on how to use attribute selection page 302. 

LAN 51 or SAN 53 include HTTP over TCP/IP. Exemplary 1Q i n the illustrated example, instruction portion 400 instructs 

communication protocols that may be used to communicate t ne user that the user must select at least four attributes in 

between selector tool server 36 A and selector tool client 36B orc jer for the tool to work. Attribute selection page 302 also 

over WAN 52 include the point-to-point protocol (PPP). includes an attribute selection portion 402 that allows the 

Selector tool server 36Apreferably performs the functions user to select attributes that are of importance to the user and 
of presenting the user with a series of choices relating to 15 that allows the user to access definitions of terms. In the 
complex alternatives, calculating relative utility scores of illustrated example, attribute selection portion 402 includes 
the alternatives based on the choices, and feeding back to the a table containing attribute categories relating to employer- 
user an indication of which of the complex alternatives has sponsored health plans, such as cost and access. Each 
the highest utility for that user. Selector tool client 36B may attribute category includes a series of attributes. In the 
establish a connection with selector tool server 36A in order 20 illustrated example, the "cost" attribute category includes 
to provide communications between the user and selector attributes such as monthly employee contribution, annual 
tool server 36A. In a preferred embodiment, selector tool deductible, separate per-admission hospital deductible, etc. 
client 36B comprises a web browser, such as Internet Similarly, the "access" attribute category includes attributes 
Explorer available from Microsoft Corporation of Redmond, such as coverage of brand name prescription drugs of choice 
Wash., or Netscape Navigator available from America 25 and the ability to self-refer to a specialist. In order to select 
Online Corporation of Reston, Va. an attribute of importance, the user clicks on the appropriate 

The present invention is not limited to a selector tool that box using an input device, such as a mouse. The attributes 

is implemented as a selector tool server and a selector tool selected by the user will be used in calculating the relative 

client connected via a network. For example, in an alterna- utilities of health plans. 

tive embodiment, the present invention may be implemented 30 Referring back to FIG. 3, once the user has selected 

entirely on a local machine wherein the selector tool com- attributes that are of importance to the user, the user is 

prises an application program that presents the user with a presented with importance page 304, which allows the user 

series of choices relating to complex alternatives, calculates to rate the importance of each attribute. FIG. 5 is a screen 

the relative utility of the complex alternatives, and feeds the shot illustrating an exemplary embodiment of importance 

relative utility information back to the user entirely on the 35 page 304. In FIG. 5, importance page 304 includes an 

local machine. However, a networked environment is pre- instructions portion 500 that explains to the user the 

ferred so that multiple users can access the selector tool mechanics of using importance page 304. Importance page 

server. For example, for company health plan selection, 304 also includes an importance of difference portion 502 

selector tool server 36A may be resident on a server acces- that presents the user with two hypothetical values that a 

sible by company employees. In this manner, all employees 40 plan could possess for each attribute: a high value and a low 

may access selector tool server 36A using a web browser value. A scale is provided that requires the user to rate how 

that is common on most personal computers. In addition, important the difference is to the user between the two 

when the health plans offered by a company change, it is possible alternatives. In the illustrated example, the attribute 

easier to update a server or a set of servers than it is to update being evaluated is monthly employee contribution to a 

software on each individual user's personal computer. 45 health plan. The user is asked to rate the importance of the 

FIG. 2 is a block diagram of selector tool server 36A. In difference between a plan with an employee contribution of 

the illustrated embodiment, selector tool server 36A includes $38 per month versus a plan with an employee contribution 

a user interface generator 200 and a utilities calculation of $90 per month. A scale is provided below the choice that 

engine 202. User interface generator 200 may be a web allows the user to rate the degree of importance between the 

server. User interface generator 200 preferably presents a 50 two settings for each variable selected: a best setting and a 

series of input screens to the user relating to choices between worst setting. In the illustrated example, the user may 

complex alternatives. User interface generator 200 also indicate that the difference between an employee contribu- 

receives input from the user and delivers that input to tion of $38 per month and an employee contribution of $90 

utilities calculation engine 202. Utilities calculation engine per month is very important. Importance page 304 stores a 

202 calculates a total relative utility value for each of the 55 value indicative of the relative importance of the difference 

complex alternatives, based on the user choices. Utilities to the user and passes this value to utilities calculation 

calculation engine 202 outputs the total utilities calculations engine 202 (illustrated in FIG. 2). 

to user interface generator 200. User interface generator 200 The user is preferably presented with a series of prefer- 
then outputs the total utilities values to selector tool client ence pages 304 that require the user to rate the relative user's 
36B. 60 preference between best and worst settings of variables 
FIG. 3 is a block diagram of exemplary screens that may relating to an attribute. Once the user has completed the 
be presented by user interface generator 200 illustrated in importance of difference rating step, referring back to FIG. 
FIG. 2. In FIG. 3, selector tool instruction page 300 provides 3, the user is presented with a series of paired trade-off pages 
an overview of how the selector tools works, steps required 306. Each paired trade-off page 306 requires the user to rate 
to be performed by the user in using the tool, and the length 65 paired sets of attributes. In particular, the user is presented 
of time required to complete the selection. Because selector with the best setting of one attribute and the worst setting of 
tool instruction page 300 does not provide an functionality another attribute versus the worst setting of the first attribute 
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and the best setting of the second attribute and the user is according to an embodiment of the present invention. In 

asked to rate the relative degree of importance of the best FIG. 7, results page 308 includes a description portion 700 

and worst settings of the different attributes. that describes the contents of results page 308. Importance 

FIG. 6 illustrates an exemplary paired trade-off page 306 indicator portion 702 includes a table having a bar graph that 

according to an embodiment of the present invention. In s graphs the importance indicator value for each of the com- 

FIG, 6, paired trade-off page 306 includes instructions plex alternatives. In the illustrated example, the bar graph 

portion 600 that instructs the user on how to select between indicates that PSC test plan 2 more closely matches the 

the alternatives presented on page 306. Paired trade-off page user's preferences than PSC test plan 1. Accordingly, based 

306 also includes a trade-off selection portion 602 which on results page 308, the user should select PSC test plan 2 

presents the user with two pairings of two different 10 as ^ user ' s health P lan - 

attributes. In a preferred embodiment, the user is presented Referring back to FIG. 3, a details page 310 can be 
with a first pairing that includes a highest setting of one accessed from any of the other pages 300, 302, 304, 306, and 
attribute and a lowest setting of another attribute and a 308 - Details page 310 explains the feature of the page from 
second pairing that contains the highest setting of one which details page 310 was accessed. For example, if details 
attribute and the lowest setting of another attribute. For 1S P a S e 310 is accessed from results page 308, a more corn- 
example, if the attributes are Al and A2, the first pairing prehensive explanation of the results will be presented. FIG. 
would be high(Al) AND low(A2), and the second pairing 8 illustrates an example of details page 310 accessed from 
would be low(Al) AND high(A2). In the example illustrated resuIts P a S e 308 - Referring to FIG. 8, details page 310 
in FIG. 6, the pairings of attributes are as follows: an annual includes an explanation portion 800 that explains the content 
deductible of $0 and an employee contribution of $90 per 20 of details page 310. Details page 310 includes a content table 
month versus an annual deductible of $500 and an employee 802 mat compares the attributes of two choices presented to 
contribution of $38 per month. The represent combinations the user * In the illustrated example, the choices are 
of high and low settings of the illustrated attributes— employer-sponsored health plans. The attributes include 
monthly contribution and annual deductible. The user is features of the health plans, such as annual deductible, 
required to rate the user's preference between the pairings 25 e . m Pl°y ee contribution, and out-of-pocket costs for prescript 
using discreet values on the scale provided below the tions. 

pairings. For example, if the user strongly prefers an annual Thus, as illustrated above, the present invention provides 
deductible of $500 and an employee contribution of $38 per a user-friendly graphical user interface that simplifies corn- 
month versus an annual deductible of $0 and an employee P kx choices for users. The users are presented with two 
contribution of $90 per month, the user may select one of the 30 series of simple choices. Based on the user's responses to the 
circles on the right side of pair trade-off page 306. sim Pl e choices » me utili ties calculation engine of the present 

Hie user is presented with a series of paired trade-off i nvention calculates the relative utility of complex choices 

screens 306 and is required to rate the user's preference for f ? r us ™; B ? ^akmg the complex choices into series of 

each of the pairings. Values indicative of each of the simple choices, the present invention greatly facilitates user 

user-selected ratings are provided to utilities calculation 35 selectl0n amon S complex choices, 

engine 202 illustrated in FIG. 2. Detailed Description of Calculations Performed by 

Once the user has completed all of the importance pages Utilities Calculation Engine 

304 and paired trade-off pages 306, the selector tool per- statistical algorithm implemented by utilities calcu- 

forms the following steps: lation engine 2 02 involves the calculation of "regression" 

1. Using utilities calculation engine 202, a "final computed 40 coe fficients (u*) for the equation: 
importance" is calculated for each "attribute" used in the 

exercise. This is a measure of the relative importance of Jr<W«i/««2'«af* - • • 

the "attribute" with respect to the "settings" of that where y,- is a variable with i possible observations per tool 

"attribute" presented as well as to the relative importance user, representing the quantitative values chosen by a indi- 

of all the other "attributes." 45 vidual to measure his or her judgment of the importance of 

2. Utilities calculation engine 202 gathers the performance the difference between some best value of each important 
levels (actual "settings") for each "alternative" available "attribute" and some worst value of the "attribute", as well 
to the "user," for each "attribute." as values input by that individual to measure his degree of 

3. For each "alternative" and "attribute" utilities calculation attraction to either of two two-" attribute" alternatives (or 
engine 202 creates a "setting utility" score for each 50 choices) (in which the key characteristic of those two- 
alternative" available to the "user." Details of this cal- "attribute" alternatives is that the first "attribute" has its best 
culation are described below. The sum of the "setting possible value while the second has its worst possible value, 
utility" scores for all the "attributes" for an "alternative" and the other alternative's two "attributes" have the char- 
become the "alternative's" "total utility" score. This value acteristic that the first "attribute" has its worst possible value 
is unique to each "alternative'Y'user" combination. 55 while the second "attribute" has its best possible value). It is 

4. The "user" is then presented with a list of all the important to note that while the "user" provides the relative 
"alternatives" available to them with a graphical repre- degree to which he/she prefers one "best/worst" "altema- 
sentation of the relative "total utility" scores of the tive" (i.e. product) to the other, the algorithm for deriving 
"alternatives." With this information, the user can ascer- "final estimated importances" (i.e. the regression analysis) 
tain how well each "alternative" matches their stated 60 interprets these responses as the mathematical difference in 
importance. the "importances" of the two "attributes." This unique 
Referring back to FIG. 2, results page 308 presents the property of the algorithm is so important that the following 

results from the utilities calculation to the user. The utilities example is warranted to clearly illustrate the mechanics, 

are measured in terms of a preference value that indicates the Assume the two "attributes" of a trade-off screen 306 are 

relative utility of each choice to that particular user. Alter- 65 price and quality and assume the "alternatives" are 

native choices may be sorted in any order, such as descend- bicyclesThus, the trade-off screen might look like the fol- 

ing order. FIG. 7 illustrates an exemplary results page 308 lowing: . 
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$500 




$100 




High Quality 


vs. 


Low Quality 


5 


-4 -3 -2 -1 


0 


+1 +2 +3 +4 





The user is asked to respond with a number between -4 
and +4, with a -4 meaning he/she strongly prefers the High 10 
Quality, $500 bicycle and a +4 meaning he/she strongly 
prefers the Low Quality, $100 bicycle. Values between +4 
and -4 indicate less strong preferences, with 0 (zero) indi- 
cating the user prefers the two bikes equally. Because all 
"attributes" are studied in the trade-off screens only in terms 15 
of their best and worst "settings" and also because exactly 
two "attributes" are studied in each trade-offscreen 306, any 
value on the +4 to -4 continuum has a second interpretation, 
besides the relative preference of one "alternative" vs. the 
other, which is the mathematical difference in the "impor- 20 
tance" of the two "attributes" being studied (where the 
"importance" values are on a +1 to +5 scale). Thus, if a user 
states a "+3" in the above trade-off, that can be interpreted 
to mean that price is more "important" than quality and 
precisely that the "importance" of price is 3 more "impor- 25 
tance" points than the "importance" of quality. In other 
words, the user may have "importance" values for price and 
quality of +4 and +1 respectively, or +5 and +2 or +4.5 and 
+1.5 (the actual importance magnitudes are gauged else- 
where (not in the trade-off screens), in the "importance" (i.e. 30 
importance of difference) screens). Other trade-off values 
have similar interpretations (e.g. a "0" is interpreted as the 
"importance" of price and quality being equal; a "-4" is 
interpreted as the "importance" of price being 4 "impor- 
tance" points less than the "importance" of quality (e.g. 35 
price "importance"«l and quality "importance"«5). Another 
way to view this is that while the user is responding (with 
respect to moving from -4 to +4) in terms of left-of-screen 
"alternative" vs. right-of-screen "alternative," the software 
algorithm interpretation is bottom-of-screen "attribute" vs. 40 
top-of-screen "attribute"." This property (interpretation) of 
the algorithm may indeed be the single most unique aspect 
of utilities calculation engine 202. 

The present invention is not limited to using any particu- 
lar scale for rating user preferences with regard to difference 45 
in importance or trade-ofls. The size and increments in the 
scale depend on the desired granularity and the algorithm 
used to generate the total utility value. 

As described above, two types of data are gathered from 
users: 

1. The importance of a single "attribute" (defined as the 
importance of the difference between the best and worst 
"settings" of that "attribute"), measured on a l-to-5 
scale (using importance pages 304). 55 

2. The difference in the importance of two "attributes. 
Since the "importance" of each "attribute" is measured 
on a l-to-5 scale (see 1 above), the "difference in 
importance" is measured on a -4-to-4 scale (since the 
minimum value is a 1 minus a 5 which equals -4 and 60 
the maximum value is a 5 minus a 1 which equals 4) 
(using paired trade-off pages 308). 

Ma regression analysis, both types of data are analyzed 
together as a single set of information. The result of this 
regression analysis is a single number for each "attribute" 65 
indicating the final estimate of how important the user feels 
the "attribute" is (on the original "importance" scale). 
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The way the data is coded is as follows: 

Dependent Variable Vector Y 

Type 1 "importance" data is simply bottom-augmented 
with the type 2 "difference in importance" data. Thus, if a 
user had been asked about 5 "attributes" and had given 
"importance" scores of 5, 4, 3, 2, and 1, the Y "importance" 
data would equal: 



5 
4 
3 
2 
1 



Similarly, if the user had seen 6 pairs of "attributes" and 
had given "difference in importance" ratings of -4, 3, 0, 1, 
0, and -2, the Y "difference in importance" data would 
equal: 



3 
0 
1 
0 
-2 



Thus, the final Y vector would equal: 



5 
4 
3 
2 
1 

-4 
3 
0 
1 
0 

-2 



The number of rows equals the number of observations of 
data used in the regression analysis and are equal to the 
number of separate data values supplied by the user for 
"importance" and for "difference in importance" questions. 

Independent Variable Matrix X 
The X matrix associated with Type 1 "importance" data is 
made of rows that are "dummy" coded with a "1" indicating 
the "attribute" the user is referring to and 0's otherwise. 
Thus, assuming the "importance" scores of 5, 4, 3, 2, and 1 
given above were in the order of first, second, third, fourth, 
and fifth "attributes, the X "importance" data would equal: 



10000 
01000 
00100 
00010 
00001 



Note that it is not necessary that the order is first, second, 
third, fourth, and fifth, however. If the data had been in, say, 
order of second, first, third, fourth, and fifth attributes, then 
the X matrix would have looked like: 



15 
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Thus, the final set of data to be analyzed is as follows: 



0 1 00 0 

1 0 00 0 
00 100 
000 1 0 
0000 1 



For this example, the former order is assumed. 

In addition to determining an X-matrix for the importance 
data entered through importance pages 304, utilities calcu- 
lation preferably also determines an X-matrix for difference 15 
of importance data collected through paired trade-off screens 
306. 

The X matrix associated with the "difference of impor- 
tance" responses is made of rows that are coded as " 1" if the 20 
"attribute" is one of the pair being traded off and is the 
"attribute" shown either at the top or the bottom of the 
screen, "-1" if the "attribute" is one of the pair being traded 
off and is the "attribute" shown opposite the other "attribute" 
(at bottom if former is at top of screen and vice versa), and 25 
"0" if the "attribute" is not one of the pair being traded off. 
For example, assuming that the "top-bottom" pairs of 
"attributes" are first-second, second-third, third-fourth, 
fourth-fifth, fifth-first, and fourth-second, and the top 30 
"attribute" has its best "setting 1 ' on the right side of the 
screen and bottom "attribute" has its best "setting" on the 
left side of the screen (though this may be interchanged), the 
X matrix associated with the "difference of importance" data 



equals 35 



1-10 0 0 

0 1-10 0 

0 0 1 -1 0 40 

0 0 0 1 -1 

-1 0 0 0 1 

0-101 0 



The above X matrix is given only as an example. Pairings of 
"attributes" may be random or a systematic approach may be 
used to pair the attributes, as in an orthogonal or near- 
orthogonal design. 

As before with the Y vector, the final X matrix is created 
by bottom-augmenting the "importance" data with the "dif- 
ference in importance" data. Thus the final X matrix equals 



1 0 


0 0 0 


0 0 


0 0 0 


0 1 


0 0 0 


0 0 


10 0 


0 0 


0 1 0 


1 -1 


0 0 0 


0 1 


-10 0 


0 0 


1-1 0 


0 0 


0 1-1 


-1 0 


0 0 1 


0-1 


0 10 



60 



65 



Y vector 


X matrix 


5 


1 0 0 0 0 


4 


0 10 0 0 


3 


0 0 10 0 


2 


0 0 0 1 0 


1 


0 0 0 0 1 


-4 


1-1 0 0 0 


3 


0 1-1 0 0 


0 


0 0 1-10 


1 


0 0 0 1-1 


0 


-1 0 0 0 1 


-2 


0-1010 


2 


0 0 0 1 0 


1 


0 0 0 0 1 


-4 


1-1 0 0 0 


3 


0 1-1 0 0 


0 


0 0 1-10 


1 


0 0 0 1 -1 


0 


-1 0 0 0 1 


-2 


0-1010 



In summary, each row (of both the Y vector and the X 
matrix) represents a single response the "user" has given, the 
actual response being recorded in the Y vector. Each column 
of the X matrix represents an "attribute" the "user" has 
chosen as important (where rows with only l's and 0's have 
a 1 in the column of the "attribute" that is the subject of the 
"importance"-of-difference screen and rows with l's, 0's, 
and -l's have a 1 or -1 in a column to identify which 
attribute was at the top of and which attribute was at the 
bottom of the trade-off screen. 

From this type data set, the B regression coefficients are 
calculated via 

where _1 indicates the matrix inversion transformation and 
the single quote (') indicates the matrix transpose 
transformation, are directly interpretable as importance (on 
the l-to-5 "importance" scale) scores for the "attributes" 
they modify. Each B coefficient is paired with and thus 
modifies one "attribute." A slight variation of this form is to 
include an additional column of ones ("l"s) in the leftmost 
position of the X matrix. The extra B coefficient in that 
instance is not associated with an "attribute" but is a measure 
of the intercept of the regression model, which theoretically 
equals zero. That is, in the absence of predicting anything 
about importance (e.g. an "importance" by plugging in a "1" 
or a "difference in importance" by plugging in a "1" and a 
"-1"), that is, only a series of zeros are plugged in, the model 
predicts zero. That is to say that the null condition of using 
the model to do nothing "predicts" a "0" (zero) "impor- 
tance." 

Each user chooses which m or more "attributes" he/she 
actually uses in making a selection, where m is a variable 
threshold and is set in advance. If this number exceeds n then 
the top n (based on the user's "importance" scores (and 
predetermined expert judgments of the importance of 
"attributes" if a tie-breaker is needed)) are used and it is only 
these that have "final computed importances" calculated via 
the above formula. Again, n is a variable threshold that is set 
in advance. For excluded "attributes, the "final computed 
importance" is set to zero. Thus, the number of "attributes" 
for which "final computed importances" are calculated var- 
ies from user to user. Currently, the software is written to 
allow for "importance" scores to be calculated for anywhere 
from four to fifteen "attributes" (that is, m«4 and n«15). 
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While it would be sufficient to simply use the (direct) 
"importance" scores for each "attribute" to help users select 
products/services, it is believed that the augmented data, the 
"difference in importance" data, greatly improves "final 
computed importances" and thus recommendation results. 5 
This is so because users are not actually told they are 
providing "difference in importance or trade-off" scores, but 
rather are told to gauge their preference for the best "setting" 
of one "attribute" paired with the worst of the other versus 10 
the worst "setting" of the one "attribute" paired with the best 
of the other. In this way, the user is actually comparing two 
products or services. Because only the best and worst 
"settings" are ever shown and because only two "attributes" 
are shown at a time, the interpretation of the responses is 
precisely "the mathematical difference in the importance of 
the two 'attributes* (each on a l-to-5 scale)." This indirect 
way of obtaining information on the relative impact impor- 
tance of "attributes" by comparing a series of hypothetical 20 
"alternatives" is a more realistic task for the "user" and is 
believed to enhance relative importance measurement. 

With "final computed importances" estimated/calculated, 
the algorithm moves to using that data to calculate "total 
utility" scores for each product or service the user is in the 
market to buy and is eligible to buy. For each "attribute", the 
"final computed importance" (i.e. the B coefficient from the 
"attribute") is taken as the value of the worst "setting" of the 
"attribute" and five times the "final computed importance" is 30 
taken to be the value of the best "setting" of the "attribute". 
Then, using linear interpolation, the "setting" or specifica- 
tion of each product or service is transformed to a value to 
be presented to the user. For example, if the "final computed 
importance" of price is 3.2 and the worst price "setting" is 
$50, and the best price "setting" is $10, then a product with 
a price of $23.33 would have a "setting utility" for price of 



25 



35 



3.2+(5*3.2-3.2)*((23.33-50)/(10-50))-11.7344. 



40 



45 



50 



The utility numbers are "unitless"; 10.6656 is not 10.6656 
dollars or anything else. They are relative numbers that 
allow for comparing specifications on different "attributes" 
for a given user. A "setting" on an "attribute" that has a "10" 
value for user is worth more than a "setting" on the same or 
another "attribute" that has a value of, say, "7." Individual 
"attribute" values are summed across the "attributes" mak- 
ing up the products or services, yielding a "total utility" 
score for each product or service for each user. 

Utilities calculation engine 202 then rank orders the 
products or services for the user, in descending order of 
"total utility." The top product or service in this list is the 55 
best recommendation for the product or service the user 
should choose, given the relative importance the user places 
on the various "attributes" that make up the products or 
services and the actual specifications of the products or 
services. 60 

Although the present invention can be used to calculate 
relative total utilities of products or services based on any 
number of attributes and attribute pairings, the following 
examples illustrate exemplary numbers of attributes and 65 
corresponding attribute pairings suitable for use with the 
present invention. 
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Pairs 



(1) 4 "attribute" engine 
Interpretation 



1,4 This array of paired integers describes the comparisons 

2.3 of combinations of "attributes" made by utilities 

3.4 calculation engine 202. The pairings listed here are for 4 
4,2 attributes and are believed to be unique. The remaining 

3.1 pairings listed herein are for 5 to 15 attributes and are 

1.2 pairings listed herein are for 5 to 15 attributes and are 

' also believed to be unique. 

(2) 5 "attribute" engine 

1,2 
2,4 
5,3 
3,1 
1,4 
3,4 
1,5 
5,2 

(3) 6 "attribute" engine 



1,2 
2,4 
5,3 
3,1 
6,4 
1,6 
3,4 
2,5 

(4) 7 "attribute" 



1,2 
2,4 
5,2 
6,7 
3,1 
7,3 
1,6 
3,4 
4,5 

(5) 8 "attribute" engine 

1,2 
5,8 
2,4 
5,2 
6,7 
3,1 
7,3 
1,6 
3,4 
8,6 
4,5 

(6) 9 "attribute" engine 

1,2 
9,7 
2,4 
7,3 
4,5 
6,1 
5,2 
8,6 
3,1 
8,9 
4,3 

(7) 10 "attribute" engine 

1,2 
9,7 
2,4 
7,3 
4,5 
10,9 
6,1 
5,2 
4,3 



US 6,826,541 Bl 



19 



20 



-continued 



-continued 



8,6 
3,1 

8,10 

(8) 11 "attribute" engine 

ia 

9,7 

2,4 

7,3 

4,5 
10,11 

6,1 

5,2 

4,3 
11,9 

8,6 

3,1 

8,10 

(9) 12 "attribute" engine 

1,2 

9,7 

2,4 
10,12 

7,3 

4,5 
12,11 

6,1 

5,2 
11,9 

4,3 

8,6 

3,1 

8,10 

(10) 13 "attribute" engine 

11,13 

1,2, 

9,7 

2,4 
10,12 

7,3 

4,5 
12,11 

6,1 

5,2 
11,9 

4,3 

8,6 

3,1 

8,10 
13,9 

(11) 14 "attribute" engine 

1,13 

1,2 

9,7 

2,4 
10,12 

7,3 

4,5 
12,11 

6,1 

5,2 
14,12 
11,9 

4,3 
10,14 

8,6 

3,1 

8,10 
13,9 

(11) 15 "attribute" engine 

11,13 
1,2 
8,15 
9,7 
2,3 



10 



15 
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65 



10,12 

7,3 

4,5 
12,11 

6,1 
14,12 
11,0 

4,3 
10,1 

8,6 
15,14 

3,1 

8,10 
13,9 



In all the above, the numbers in the pairs (e.g. "13,9") 
signify the two attributes in terms of the rank order of their 
"importance" ratings by the user. For instance, "13,9" sig- 
nifies the 13' A most important attribute and the 9 th most 
important attribute. 

Criteria Matching Heuristic 

According to another aspect, the present invention 
includes a criteria matching heuristic for determining alter- 
natives available to a user based on information received 
from the user. 

One of the critical issues in applying a decision tool to the 
selection of an "alternative" is ensuring the "user" is pre- 
30 sented with those "alternatives" that are available to him/her 
in the marketplace. Especially within the realm of health 
care plan choice, plans are often times available only based 
on specific, and sometimes complicated criteria (zip code, 
employment status, etc). In addition, not only does the 
"user" need to be "matched" to those product "alternatives" 
available to them, but they must also be presented with the 
"attributes" and "attribute settings" that apply to them. For 
example, users" looking for health plan coverage for a 
family will need to see a different set of premiums than do 
40 users looking for self-coverage. These two pre-requisites, 
match users to the appropriate "alternatives" and "attribute 
settings," are critical to the goal of providing the "user" with 
an accurate and useful end product. 
The present invention, in attempting to solve these 
45 requirements, includes a unique criteria matching solution. 
This solution relies on a data driven mechanism that auto- 
mates and "genericizes" the process of matching "users" to 
"alternatives" and "attribute/attribute settings," regardless of 
the "alternative" category and "attributes" involved. The 
50 criteria matching system works as follows: 

1) Specific criteria, which may be used to link a "user" to 
an "alternative" or "attribute," are created. This could 
include such things as "single" or "family" or "full 
time," etc. These criteria are populated in a database 
table. 

2) The "attributes" to be used in the project are also 
populated in a separate database table. 

3) A "join" table is created that links which criteria apply 
to each of the "alternatives." 

4) An "alternative" can have multiple criteria associated 
with it, while a criteria can be associated with multiple 
"alternatives." 

5) The "alternatives" to be used in the project are popu- 
lated in a separate database table. 

6) A"join" table is created that links the criteria that apply 
to each of the "attributes." 
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7) An "alternative" can have multiple criteria associated 
with it, while criteria can be associated with multiple 
"attributes." 

Part of the selector tool described above is the "registra- 
tion." This is the initial step that requires the user to input 
criteria determining questions, such as "What is your zip 
code," etc. These registration questions are also data 
driven — that is, the questions and the responses are drawn 
from one data table and are written to another data table. The 
answers to these registration questions are linked, via 
another join table, to the criteria that have been established 
for the project. 

Once the user answers registration questions, the 
responses trigger a look up of which criteria apply to the 
user. Using this criteria and the criteria-"alternative" and 
criteria-"attribute" join tables, the user is automatically 
matched with the "alternatives" and "attributes" that are 
applicable to them. One example would be the question, "are 
you a member of any of the following unions? APWU, 
Mailhandlers or Postal Workers. If the user answers "yes," 
and selects APWU, then the application would only match 
the user's preferences to plans which are available to mem- 
bers of this union and with the benefit structure of that plan 
which is only available to members of that union. Another 
example might be a user's answer to the questions, 1) what 
is your age, and 2) are you eligible for Medicare? Again, if 
the user answers "Yes," the user will only be shown plans to 
which that user is eligible and at the rates that are applicable 
to person's eligible for Medicare. 

This structure has been developed so that it is 
"alternative"-category and "attribute" in-specific; it is a 
highly flexible methodology for meeting the purpose of 35 
joining users to "alternatives" and "attributes." 

Criteria Matching Heuristic Example 



The following is an abbreviated example of how the 
criteria matching heuristic works for a health plan selection 
tool according to an embodiment of the present invention. In 
this example, the following assumptions are made: 

There are 2 types of employees, Union 1 and Union 2. 
For any given plan, premium varies by coverage level as 

well as the union to which the employee belongs. 
Employees can choose from 2 types of coverage levels — 

individual coverage and family coverage. 
There are 6 possible health plans: 

2 available in NY zip codes (Plan A, Plan B) 

2 available in NJ (Plan C, Plan D) 

1 available nationally (Plan E) 

1 available regardless of coverage area, but the 
employee must belong to Union 1 (Plan F) 
The following questions can be presented to each 
employee through a graphical user interface: 
Question 1: What Union do you belong to? 

1. Union 1 

2. Union 2 

Question 2: What type of coverage level are you looking 
for? 

1. Individual 

2. Family 



Question 3: What is your zip code? 

The following tables are used by the selector tool to match 
users with attributes and products. Each of these tables may 
be stored in a computer-readable medium, such as a memory 
device. 

TABLE 1 

Criteria - Defines the criteria needed for the 
project to match users with attributes and 
products (such as health plans). Note the 
ZipCodeExclusive flag may be used to prevent 
certain user groups from being matched to 
products based on coverage area (zip cade) if need. 
The ZipCodeExclusive flag is not used in this example. 



Criteria_ID Description 
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CriteriaType ZipCodeExclusive 



1 


All Users 


Ubiquitous 


N 


2 


Union 1 


Ubiquitous 


N 


3 


Union 2 


Ubiquitous 


N 


4 


Union 1, Individual 


Attribute 


N 


5 


Union 1, Family 


Attribute 


N 


6 


Union 2, Individual 


Attribute 


N 


7 


Union 2, Family 


Attribute 


N 


8 


Individual 


Attribute 


N 


9 


Family 


Attribute 


N 



TABLE 2 



ProductCriteria - Defines which plans are 
matched via criteria. There are two steps 
to matching users to products (plans). 
Step one is by association with criteria. 
Step two is by zip code coverage. 



Criteria_ID 



Product_ID 



TABLE 3 



ProductAttribute - Defines the attributes for a project 



ProductAttribute_ID 



Description 



Premium 
Annual 
Deductible 
Chiropractic 



TABLE 4 



Product - Defines the products 
(such as health plans) for a project 

ProductAttribute_ID Description 



1 


Plan A 


2 


PlanB 


3 


PlanC 


4 


PlanD 


5 


PlanE 


6 


PlanF 
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TABLE 5 
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AttributeOption - Defines the possible variants 
of attributes for a project. For example, while 
there is one attribute "annual deductible," 
there are 2 sets of values for each plan - 
the individual value and the family value, 
Depending on the desired coverage level, users 
should be matched to the appropriate plan values. 



ProductAttribute_ID 



Criteria_lD Description 



1 


4 


Premium, Union 






1, Individual 


1 


6 


Premium, Union 






2, Individual 


1 


5 


Premium, Union 






1, Family 


1 


7 


Premium, Union 






2, Family 


2 


8 


Annual 






Deductible, 






Individual 


2 


9 


Annual 






Deductible, 






Family 


3 


1 


Chiropractic 


TABLE 6 



ProductCoverage - Associates Products with zip codes. 
In Table 6, the zip codes have been abbreviated as 
"new york zips" and "new jersey zips" 
for purposes of this example. In a real project, 
for each product, a record would exist for each 
zip code associated with the product 



Zipcode 



Product_ID 



(new jersey zips) 


1 


(new jersey zips) 


2 


(new york zips) 


3 


(new york zips) 


4 


(both new york and new jersey zips) 


5 



10 



15 



20 



25 



30 



35 



40 



Steps for Performing Criteria Matching Heuristic 

1. The user is asked to answer the registration questions. 
Depending on how the user answers the questions, criteria 
are associated with each user type. 

2. Once users are associated with criteria, joins are done to 
determine which products are available to the user. This is 
a 2-step process. In step 1 users are matched with plans 
that are only associated by criteria (not coverage area (zip 
code)). The ProductCriteria table (Table 2) is used for this 
purpose. 

In step 2 users are matched to products by coverage area 
(zip code). The ProductCoverage table (Table 6) is used 
for this purpose. 

3. In addition, to joining the user with products, users are 
also matched to their appropriate attributes; that is, the 
attributes that are available and pertinent to their decision, 
based on the registration questions. 

4. Once these joins have been done, the user can proceed 
with using the tool. 

Sample Answers and Results 

1. The user answers Ql "Union 1," Q2 "individual" and Q3 
as a New Jersey zip code. 

2. 4 criteria are associated with the user: 
1, 2,4 and 8 

3. Step 1 of matching the user with the products available to 
the user is to see if any of the user's criteria meet the 



45 



60 



ProductCriteria conditions. In this case, the user would be 
eligible for product_id 6 (Plan F) since the user's criteria 
of 2 matches a record in the ProductCriteria table (Table 
2)- 

4. Step 2 of matching the user with the products available to 
the user is to see which plans, if any, are available to the 
user due to the user's zip code. In this case product_ids 
1 (Plan A), 2 (Plan B) and 4 (Plan E) would be available 
to the user based on the zip code that the user entered. 

5. Now the user is matched with attributes. Given the user's 
criteria, the user would be matched with the 
ProductAttribute_id/Criteria_id combinations of 1,4 
(Premium, Union 1, Individual) 2, 8 (Annual deductible, 
Individual) and 3, 1 (Chiropractic, all users). With this 
identified, the tool can ensure the user trades oif between 
the relevant attributes, and that the attribute values used 
for each plan are appropriate for the user. 

Other Applications 

Although the invention has been described above with 
regard to health plan selection, the present invention is not 
limited to such an embodiment. The selector tool software 
according to the present invention can be modified to assist 
users in almost any complex decision. Examples of addi- 
tional applications of the selector tool software are discussed 
in detail below. 

At the core of the selector tool software are seven steps: 

1. Create a list of product or service attributes, which can be 
objectively collected for all products or services offered. 
Create levels for these attributes so their values can be 
compared. 

2. Allow users of the software to simply click on those 
attributes or features, which are important to them. 

3. For each attribute selected, show the high and low levels 
for each, and ask the user to determine how important the 
difference between the extremes are in their selection 
process. 

4. Using the algorithms discussed above, present the user 
with unique combinations (paired comparisons) of 
attributes which they have indicated as very important, 
and force them to make trade-off decisions between 
hypothetical plans/products which contain these features. 

5. Present the results of their preference exercise by showing 
them all products available to them in priority order, based 
on how well each product fits the user's profile 

6. Allow the user to access a "Compare" feature, which 
allows the user to compare any four plans or products; 
side-by-side, feature-by-feature 

7. Allow the user to purchase or enroll in whatever they 
choose. 

One additional application of the invention is to assist 
patients and physicians in making complex medical deci- 
sions. For instance, the selector tool can be used to help 
patients choose between angioplasty or bypass. It can be 
used to help patients choose between radical mastectomy or 
lumpectomy or choosing between drugs. 

Another application for the present invention is a virtual 
on-line brokerage firm, initially offering health plans to 
small businesses nationwide. 

Another application of the invention is for a company 
which can broker energy company services in de-regulated 
states. There are already more than 15 states which are 
deregulated and more are moving in this direction. The 
selector tool will allow businesses and consumers to click on 
what is important to them, make tradeoffs (for instance 
between cost, comfort, green-power, other bundled services, 
etc.) and have the software tell them which plan fits their 
needs best. 
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Yet another application for the selector tool is for an 
Internet-based recruiting business. Such a business would be 
tremendously empowered through use of the selector tool 
technologies. With monster.com, for instance, searching is 
done based on simple questionnaires. The results are simply 5 
a list, in no priority order, of resumes or positions that fit a 
simple set of criteria. With selector tool technology, both the 
employers looking for employees, and consumers looking 
for positions, would be asked to fill out a detailed profile, 
which would be databased. Then, when either party is doing 
a search, they would go through the attribute selection, 
importance of difference and trade-off exercises; and the 
system would list all possibilities, in priority order as to how 
well they fit the preference profile. This would be much 
more efficient than currently available systems. 

Yet another application of the invention is selection of 15 
assisted living facilities. The parents of millions of "baby 
boomers" are now at a time in their lives when they are 
considering full-care retirement centers, rest and nursing 
homes. There is no good source for them to search for 
centers which fit their needs economically, geographically 20 
and in terms of life-style needs. A web-based retirement 
home selection application would be a perfect use of the 
selector tool set. The company managing such a tool will 
database information on every retirement center and rest- 
home in America (or the world) and allow the users to click 25 
on what is important to them and make trade-offs. The tool 
would then list all centers which fit the preference profile of 
the user, in priority order as to how well they fit that person's 
desires. 

Yet another application for the present invention is home 30 
selection. The MLS system has an existing database and an 
individual or couple could click on attributes ranging from 
price, distance from work and schools, style, etc. and 
quickly match their desires with homes that are available in 
any region they wish to explore. The selector tool would 35 
allow the user to select attributes that are important to the 
user, go through the importance and trade-off screen, and 
present the user with a listing of homes and corresponding 
utility values indicating which home most closely fits the 
user's preferences. 40 

Still another application of the invention is selection of 
educational institutions. Choosing a college or university is 
always a challenge. There are books (Fiske and others) 
which offer a great deal of data, but searching is clumsy and 
unsophisticated on currently available web sites. The present 45 
invention could easily database college and university 
information, have links to their web sites and offer a 
powerful prioritizing service. Perhaps an even bigger market 
could be community-based, helping parents and students 
choose magnet schools, charter schools and other primary 50 
schools. This will become an increasingly big market 
because there is increasing interest in developing competi- 
tion for schools in order to drive-up quality of schools 
through increased competition. School systems would fund 
implementation of a web-based educational institution 55 
selector tool, with research revenue and marketing fees to 
schools creating a powerful revenue stream. 

Yet another application of the invention is an on-line 
dating service. Most on-line dating services ask a series of 
questions and perform a simple matching process. A selector 60 
tool would allow a wide variety of attributes to be selected 
by a user, importance of differences calculated between 
extremes and then trade-offs made. This could be the only 
on-line dating service which would show the user, in priority 
order, those people who fit them best. Such a tool could even 65 
include prototypical pictures of faces, bodies, etc for selec- 
tion and trade-off. 
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Still another user for the present invention is to assist 
companies in making complex business decisions. Most 
major companies spend months and months, and thousands 
of dollars on staff and consultants to choose vendors for 
major hardware, software, builders, etc. Hie selector tool 
could be used to streamline evaluation of vendors in 
extremely complex situations. 

As an example, a hospital is attempting to determine 
which new electronic medical records system should be 
purchased and implemented. Usually, a task force is estab- 
lished and an expensive consulting firm is retained. It takes 
months to specify the requirements, identify prospective 
vendors, interview vendors, write an RFP, evaluate the RFPs 
and make a selection. The tool would first be used with all 
key staff people within the hospital (finance, medical 
records, nurses, physicians, etc.), who would go through the 
selector tool in a mock selection. The selector tool will have 
in the system, every possible attribute to be considered in 
selection of a medical records system. All key people would 
take, for instance, 1 hour to thoughtfully go through the site, 
click on attributes, rate importance of difference and make 
trade-offs. The tool would then produce a report showing 
precisely what attributes are most important and even seg- 
menting the results by divisions. This would greatly speed 
up the process of developing the RFP. After vendors respond 
to the RFP, real data from each vendor would be put into the 
selector tool and the same hospital staffers would go through 
the tool, this time to make a real selection. The selector tool 
would then show results for each users and aggregate the 
data from all users to show which system fits the needs of the 
hospital best. It would show every vendor, in priority order 
of fit, and then allow senior staff to configure and refine 
requirements and show which vendor is a best fit. This tool 
set could reduce decision time in half and increase consen- 
sus among staff member. 

Other Business-to-Business Concepts 

There are almost unlimited uses for the selector tool set 
for complex decision making in business. Below are just a 
few more concepts: 

1. Helping employees with relocation 

2. Choosing hospitals 

3. Choosing physicians 

4. Choosing consulting firms 

5. Choosing architectural firms 

6. Choosing commercial real estate 

7. Choosing ISPs or ASPs 

8. Choosing resorts 

9. Choosing any benefits 

Thus, as is apparent from the examples above, the selector 
tool according to the present invention greatly facilitates 
complex decision making in a variety of fields. 

Scalability, Adaptability, and Efficiency 

Another aspect of the present invention is its scalability 
and ability to adapt to different applications. FIG. 9 shown 
below is a block diagram of a preferred embodiment of a 
selector tool server according to the present invention. In 
FIG. 9, selector tool server 36A includes presentation layer 
900, business layer 902, and data layer 904. Presentation 
layer 900 contains functions for presenting text and graphics 
to the user. Business layer 902 includes components, which 
are separately compiled from application layer code, and 
extract and store data in data layer 904. Data Layer 904 
stores data, such as attributes and available products or 
services, for a given application. 



US 6,826 : 

27 

Presentation layer 900 may be written in any suitable 
presentation layer language, such as Microsoft Active Server 
Pages (ASP). Microsoft ASP is a script-based language that 
uses HTML for presentation. The Present invention is not 
limited to using Microsoft ASP. Other languages that could 5 
be used include JSP — a Java-based language, or Cold 
Fusion. Presentation layer 900 is written to handle any client 
and any complex decision. Components that change from 
one application to another are data driven. For example, in 
order to modify the selector tool for use with a new 
application, it is not necessary to modify the code that 
creates the various graphical user interfaces. It is only 
necessary to modify data that changes from one application 
to the next, which is stored in data layer 904. For example 
to change from a health plan selector tool to a 401(k) 
selector tool, it is only necessary to change the attributes and 15 
the available plans in data layer 904. 

According to another aspect of the invention, selector tool 
server 36Aruns session-less. For example, when user when 
the user changes from one screen to the next, server iden- 
tification of the user was previously accomplished using a 20 
session-level variable. Currently, a temporary cookie is 
created in the user's browser when a user first accesses the 
tool. The cookie holds a unique identifier to identify the user 
as the user changes from page to page. 

According to yet another aspect of the invention, no 25 
database calls done through presentation layer 900. All calls 
to the database are done via components, which are part of 
business layer 902. Using components to access data greatly 
reduces overhead. As discussed above, a component is a 
separately compiled piece of code with a dedicated function, 30 
such as "get product IDs available for this user." These 
components are called by presentation layer 900 when the 
function is needed. For example, for the attribute selection 
page, an attribute selection component extracts the attributes 
that are available for a specific user. Another component 35 
present in business layer 902 is the conjoint analysis engine, 
which is described in detail above. 

According to another aspect of the invention, content, 
such as instructions for using the tool and other material 
displayable by the selector server, is preferably located in a 40 
content database in data layer 904. Storing the content in a 
content database allows content to be quickly altered and 
customized for new clients or changing client needs, Data 
layer 904 may be implemented using any suitable database 
language, such as Microsoft Structured Query Language 45 
(SQL) Server Version 7.0. 

According to yet another aspect of the invention, the 
underlying data schema has been created to be flexible and 
"generic." As used herein, the phrase "data schema" refers 
to the data structures and databases in data layer 904 used to 50 
generate the attributes and questions presented to the user. 
Rather than product or company-specific data structures, 
data structures are now generic. For example, rather that 
having a data structure created around the specific functional 
needs and specificities of a single client/product (i.e., health 55 
plans available to XYZ Corporation), a generic data schema 
has been developed that accommodates the data needs of the 
application regardless of the client and or product category. 
As a result providing generic data structures, the selector 
tool can be used for multiple clients and among multiple 60 
product categories, with little if any changes to the data 
schema. 

According to another aspect of the invention, all fre- 
quently used query objects are indexed. A query object is a 
field in a database in data layer 904 that the selector tool 65 
might access. Indexing allows faster access to frequently 
accessed data. 
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As a result of the features listed above and factors relating 
to efiicient coding, the selector tool server is capable of 
meeting the needs of multiple clients simultaneously. Cur- 
rent load testing demonstrates ability to handle 2,000 or 
more concurrent users. 

It will be understood that various details of the invention 
may be changed without departing from the scope of the 
invention. Furthermore, the foregoing description is for the 
purpose of illustration only, and not for the purpose of 
limitation — the invention being defined by the claims. 

What is claimed is: 

1. A method for facilitating user selection among complex 
alternatives using conjoint analysis, the method comprising: 

using a software-implemented selector tool: 

(a) obtaining demographic information from a user; 

(b) executing a criteria matching heuristic, wherein the 
criteria matching heuristic automatically selects prod- 
ucts or services and attributes associated with the 
products or services that are available to the user by 
accessing a first table that associates the demographic 
information with criteria identifiers and accessing a 
second table that matches criteria identifiers with prod- 
ucts or services; 

(c) presenting the user with a list of the attributes asso- 
ciated with the products or services available to the user 
and requiring the user to select among the attributes 
those which are of importance to the user; 

(d) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the attributes selected by the 
user; 

(e) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(f) responsive to receiving the first and second values 
from the user, applying automated conjoint analysis to 
the first and second values, wherein applying auto- 
mated conjoint analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

(g) in response to completion of the automated conjoint 
analysis, rating the products or services available to the 
user based on the final importance values for the 
attributes linked to the corresponding stored product or 
service alternatives; and 

(h) in response to completion of the calculating and the 
rating, automatically providing feedback from the con- 
joint analysis to the user, wherein providing feedback 
includes presenting the user with data indicating the 
relative utility to the user of each of the products or 
services. 

2. The method of claim 1 wherein presenting the user with 
a list of attributes includes providing a graphical user 
interface for displaying the attributes to the user and receiv- 
ing user selections of the attributes. 
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3. The method of claim 2 wherein providing a graphical 
user interface includes providing a graphical user interface 
using an application resident on a computer local to the user. 

4. The method of claim 2 wherein providing a graphical 
user interface includes providing a graphical user interface 5 
using a server application resident on a computer remote 
from the user. 

5. The method of claim 1 wherein requiring the user to 
input or select first values includes presenting discrete 
choices indicative of the relative importance of each 
attribute and requiring the user to select one of the discrete 
choices. 

6. The method of claim 5 wherein presenting discrete 
choices to the user includes providing a graphical user 
interface having an importance of difference selection por- 
tion for allowing the user to select one of the discrete 35 
choices. 

7. The method of claim 6 wherein providing a graphical 
user interface includes providing a graphical user interface 
using a program resident on a computer local to the user. 

8. The method of claim 6 wherein providing a graphical 20 
user interface includes providing a graphical user interface 
using a server resident on a computer remote from the user. 

9. The method of claim 1 wherein presenting the user with 
a second series of choices includes presenting the user with 
discrete choices indicating the relative importance of the 25 
difference between each pairing of attributes. 

10. The method of claim 9 wherein presenting discrete 
choices to the user includes providing a graphical user 
interface having a difference in importance selection portion 
for allowing the user to select one of the discrete choices. 30 

11. The method of claim 10 wherein providing a graphical 
user interface includes providing a graphical user interface 
using a program resident on a computer local to the user. 

12. The method of claim 10 wherein providing a graphical 
user interface includes providing a graphical user interface 35 
using a server resident on a computer remote from the user. 

13. The method of claim 1 wherein rating the products or 
services available to the user includes adding the final 
importance values of attributes associated with each product 

or services and presenting the sums to the user. 40 

14. The method of claim 13 wherein presenting the sums 
to the user includes presenting the sums to the user using a 
graphical user interface. 

15. The method of claim 14 wherein presenting the sums 

to the user using a graphical user interface includes present- 45 
ing the sums to the user using a graphical user interface 
generated by an application program resident on a computer 
local to the user. 

16. The method of claim 14 wherein presenting the sums 

to the user using a graphical user interface includes gener- 50 
ating the graphical user interface using a server resident on 
a computer remote from the user. 

17. The method of claim 1 wherein obtaining demo- 
graphic information from the user includes presenting the 
user with a series of computer screens having questions 55 
relating to the user. 

18. The method of claim 1 wherein the products or 
services include employer-sponsored health plans. 

19. The computer program product of claim 1 wherein 
obtaining demographic information from the user includes 60 
presenting the user with a series of computer screens having 
questions relating to the user. 

20. The method of claim 1 wherein the attributes and the 
product or services alternatives are stored in a database. 

21. The method of claim 20 wherein the attributes and 65 
product or service alternatives comprise non-company- 
specific attributes and product or service alternatives. 
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22. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a list of attributes relating to a 
product or service and requiring the user to select 
among the attributes those which are of importance to 
the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes, wherein calculating a final 
importance value includes: 

(a) generating a Y vector including the first values 
and the mathematical differences; 

(b) generating an X matrix having a first portion 
indicating the ordering of the first values in the Y 
vector and second portion indicating the pairing of 
attributes corresponding to each mathematical dif- 
ference in the Y vector; 

(c) computing regression coefficients based on the Y 
vector and X matrix; and 

(d) interpreting the regression coefficients as impor- 
tance scores for attributes corresponding to the 
regression coefficients; 

(e) in response to completion of the automated conjoint 
analysis, rating the products or services based on the 
final importance values; and 

(f) presenting the user with data indicating the relative 
utility to the user of each of the products or services. 

23. The method of claim 22 wherein calculating a final 
importance value for each of the attributes includes taking 
each regression coefficient as the value of the worst setting 
of an attribute and five times the final computed importance 
value as the best setting of the attribute and using linear 
interpolation to determine the final importance value. 

24. The method of claim 23 wherein the final importance 
values for each of the attributes are unitless quantities. 

25. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a list of attributes relating to 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
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eating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 5 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 1 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; ^ 

(e) responsive to completion of the conjoint analysis, 
rating the products or services based on the final 
importance values and stored links between the 
attributes and the products or services; and 

(f) responsive to completion of the rating, providing 25 
feedback from the conjoint analysis to the user, wherein 
providing feedback includes presenting the user with 
data indicating the relative utility to the user of each of 
the products or services, wherein the predetermined 
products or services include mutual funds. 30 

26. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a list of attributes relating to 35 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 40 
eating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 45 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 

of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 50 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each second values as a mathematical 
difference between the relative importance of a best 
setting and a worst setting for one attribute and a best 55 
setting and a worst setting for another attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

(e) responsive to completion of the conjoint analysis, go 
rating the products or services available to the user 
based on the final importance values and stored links 
between the attributes and the products or services; and 

(f) responsive to completion of the rating, providing 
feedback from the conjoint analysis to the user, wherein 65 
providing feedback includes presenting the user with 
data indicating the relative utility to the user of each of 
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the products or services, wherein the predetermined 
products or services include consumer goods other than 
health plans. 

27. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a list of attributes relating to 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

(e) responsive to completion of the conjoint analysis, 
rating the products or services available to the user 
based on the final importance values and stored links 
between the attributes and the products or services; and 

(f) responsive to completion of the rating, providing 
feedback from the conjoint analysis to the user, wherein 
providing feedback includes presenting the user, with 
data indicating the relative utility to the user of each of 
the products or services, wherein the products or ser- 
vices include medical services. 

28. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a fist of attributes relating to 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
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of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 5 
each of the attributes; 

(e) responsive to completion of the conjoint analysis, 
rating the products or services available to the user 
based on the final importance values and stored links 
between the attributes and the products or services; and io 

(f) responsive to completion of the rating, providing 
feedback from the conjoint analysis to the user, wherein 
providing feedback includes presenting the user with 
data indicating the relative utility to the user of each of 
the products or services, wherein the products or ser- 15 
vices include energy providers. 

29. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 20 

(a) presenting a user with a list of attributes relating to 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 25 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 30 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 

of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each second values as a mathematical 
difference between the relative importance of a best ^ 
setting and a worst setting for one attribute and a best 
setting and a worst setting for another attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

(e) responsive to completion of the conjoint analysis, 
rating the products or services available to the user 
based on the final importance values and stored links 
between the attributes and the products or services; and 

(f) responsive to completion of the rating, providing 50 
feedback from the conjoint analysis to the user, wherein 
providing feedback includes presenting the user with 
data indicating the relative utility to the user of each of 
the products or services, wherein the products or ser- 
vices include assisted living facilities. 55 

30. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a list of attributes relating to 60 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 65 
eating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 
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(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

(e) responsive to completion of the conjoint analysis, 
rating the products or services available to the user 
based on the final importance values and stored links 
between the attributes and the products or services; and 

(f) responsive to completion of the rating, providing 
feedback from the conjoint analysis to the user, wherein 
providing feedback includes presenting the user with 
data indicating the relative utility to the user of each of 
the products or services, wherein the products or ser- 
vices include educational institutions. 

31. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a list of attributes relating to 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

(e) responsive to completion of the conjoint analysis, 
rating the products or services available to the user 
based on the final importance values and stored links 
between the attributes and the products or services; and 

(f) responsive to completion of the rating, providing 
feedback from the conjoint analysis to the user, wherein 
providing feedback includes presenting the user with 
data indicating the relative utility to the user of each of 
the products or services, wherein the products or ser- 
vices include potential employees or employers. 
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32. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a list of attributes relating to 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

(e) responsive to completion of the conjoint analysis, 
rating the products or services available to the user 
based on the final importance values and stored links 
between the attributes and the products or services; and 

(f) responsive to completion of the rating, providing 
feedback from the conjoint analysis to the user, wherein 
providing feedback includes presenting the user with 
data indicating the relative utility to the user of each of 
the products or services, wherein the products or ser- 
vices include polential companions available through 
an on-line dating service. 

33. A computer program product comprising a computer 
executable instructions embodied in a computer readable 
medium for performing steps comprising: 

using a software-implemented selector tool: 

(a) obtaining demographic information from a user; 

(b) executing a criteria matching heuristic, wherein the 
criteria matching heuristic automatically selects prod- 
ucts or services and attributes associated with the 
products or services that are available to the user by 
accessing a first table that associates the demographic 
information with criteria identifiers and accessing a 
second table that matches criteria identifiers with prod- 
ucts or services; 

(c) presenting a user with a list of the attributes associated 
with the products or services available to the user and 
requiring the user to select among the attributes those 
which are of importance to the user; 

(d) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes selected 
by the user; 

(e) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
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ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 
(f) responsive to receiving the first and second values 
5 from the user, applying automated conjoint analysis to 
the first and second values, wherein applying auto- 
mated conjoint analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 

10 of a best setting and a worst setting for one attribute 

and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

15 (g) in response to completion of the automated conjoint 
analysis, rating the products or services available to the 
user based on the final importance values for the 
attributes linked to the corresponding stored product or 
service alternatives; and 
20 (h) in response to the completion of the calculating and 
the rating, automatically providing feedback from the 
conjoint analysis to the user, wherein providing feed- 
back includes presenting the user with data indicating 
the relative utility to the user of each of the products or 
25 services. 

34. The computer program product of claim 33 wherein 
presenting the user with a list of attributes includes provid- 
ing a graphical user interface for displaying the attributes to 
the user and receiving user selections of the attributes. 
30 35. The computer program product of claim 34 wherein 
providing a graphical user interface includes providing a 
graphical user interface using an application resident on a 
computer local to the user. 

36. The computer program product of claim 34 wherein 
35 providing a graphical user interface includes providing a 

graphical user interface using a server application resident 
on a computer remote from the user. 

37. The computer program product of claim 33 wherein 
requiring the user to input or select first values includes 

40 presenting discrete choices indicative of the relative impor- 
tance of each attribute and requiring the user to select one of 
the discrete choices. 

38. The computer program product of claim 37 wherein 
presenting discrete choices to the user includes providing a 

45 graphical user interface having an importance of difference 
selection portion for allowing the user to select one of the 
discrete choices. 

39. The computer program product of claim 38 wherein 
providing a graphical user interface includes providing a 

50 graphical user interface using a program resident on a 
computer local to the user. 

40. The computer program product of claim 39 wherein 
providing a graphical user interface includes providing a 
graphical user interface using a server resident on a com- 

55 puter remote from the user. 

41. The computer program product of claim 33 wherein 
presenting the user with a second series of choices includes 
presenting the user with discrete choices indicating the 
relative importance of the difference between each pairing of 

60 attributes. 

42. The computer program product of claim 41 wherein 
presenting discrete choices to the user includes providing a 
graphical user interface having a difference in importance 
selection portion for allowing the user to select one of the 

65 discrete choices. 

43. The computer program product of claim 42 wherein 
providing a graphical user interface includes providing a 
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graphical user interface using a program resident on a 
computer local to the user. 

44. The computer program product of claim 42 wherein 
providing a graphical user interface includes providing a 
graphical user interface using a program resident on a 5 
computer remote from the user. 

45. The computer program product of claim 33 wherein 
rating the products or services available to the user includes 
adding the final importance values of attributes associated 
with each product or services and presenting the sums to the Q 
user. 

46. The computer program product of claim 45 wherein 
presenting the sums to the user includes presenting the sums 
to the user using a graphical user interface. 

47. The computer program product of claim 46 wherein 15 
presenting the sums to the user using a graphical user 
interface includes presenting the sums to the user using a 
graphical user interface generated by an application program 
resident on a computer local to the user. 

48. The computer program product of claim 46 wherein 2Q 
presenting the sums to the user using a graphical user 
interface includes generating the graphical user interface 
using a server resident on a computer remote from the user. 

49. The computer program product of claim 33 wherein 
the products or services include employer-sponsored health ^ 
plans. 

50. The computer program product of claim 33 wherein 
the products or services include mutual funds. 

51. The computer program product of claim 33 wherein 
the products or services include consumer goods. 3Q 

52. The computer program product of claim 33 wherein 
the products or services include medical services. 

53. The computer program product of claim 33 wherein 
the products or services include energy providers. 

54. The computer program product of claim 33 wherein 35 
the products or services include assisted living facilities. 

55. The computer program product of claim 33 wherein 
the products or services include educational institutions. 

56. The computer program product of claim 33 wherein 
the products or services include potential employees or ^ 
employers. 

57. The computer program product of claim 33 wherein 
the products or services include potential companions avail- 
able through an on-line dating service. 

58. The computer program product of claim 33 wherein 45 
the products or services include combinations of comple- 
mentary products or services. 

59. The computer program product of claim 58 wherein 
the products or services include employee benefits. 

60. A method for facilitating user selection among com- 5Q 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software -implemented selector tool: 

(a) presenting a user with a list of attributes relating to a 
product or service and requiring the user to select 55 
among the attributes those which are of importance to 
the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 60 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 65 
attributes, wherein each pairing includes a best setting 

of one attribute and a worst setting of another attribute; 



(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes, wherein calculating a final 
importance value includes: 

(a) generating a Y vector including the first values 
and the mathematical differences; 

(b) generating an X matrix having a first portion 
indicating the ordering of the first values in the Y 
vector and second portion indicating the pairing of 
attributes corresponding to each mathematical dif- 
ference in the Y vector; 

(c) computing regression coefficients based on the Y 
vector and X matrix; and 

(d) interpreting the regression coefficients as impor- 
tance scores for attributes corresponding to the 
regression coefficients; and 

(e) rating the products or services based on the final 
importance values; and 

(f) presenting the user with data indicating the relative 
utility to the user of each of the products or services. 

61. The computer program product of claim 60 wherein 
calculating a final importance value for each of the attributes 
includes taking each regression coefficient as the value of the 
worst setting of an attribute and five times the final com- 
puted importance value as the best setting of the attribute 
and using linear interpolation to determine the final impor- 
tance value. 

62. The computer program product of claim 61 wherein 
the final importance values for each of the attributes are 
unitiess quantities. 

63. A system for facilitating user selection among com- 
plex alternatives using conjoint analysis, the system com- 
prising: 

(a) a user interface generator for executing a criteria 
matching heuristic, wherein the criteria matching heu- 
ristic automatically selects products or services avail- 
able to the user by obtaining demographic information 
from the user, accessing a first table that associates the 
demographic information with criteria identifiers and 
accessing a second table that matches criteria identifiers 
with products or services, the user interface generator 
for presenting screens to a user on a computer display 
device that require the user to rate the relative impor- 
tance of the selected attributes for the selected products 
or services and for receiving input from the user 
regarding the attributes; and 

(b) a conjoint analysis engine operatively associated with 
the user interface generator for receiving the user input 
for applying automated conjoint analysis to the user 
input, wherein applying automated conjoint analysis 
includes automatically calculating final importance val- 
ues for each of the selected attributes and wherein the 
conjoint analysis engine is further adapted to calculate, 
based on the final importance values and the stored 
links between the selected attributes and the products or 
services, a total utility value for each of the products or 
services, and wherein the conjoint analysis engine is 
further adapted to provide feedback to the user based 
on the conjoint analysis, wherein providing feedback 
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includes delivering the total utility values to the user 
interface generator, which displays to the user the 
products or services with ratings based on the total 
utility values. 

64. The system of claim 63 wherein the user interface 5 
generator is adapted to present the user with a first series of 
screens requiring the user to rate the relative importance 
between high and low settings of individual attributes. 

65. The system of claim 64 wherein the user interface 
generator is adapted to present the user with a second series 
of screens requiring the user to rate the relative importance 
of the difference between a high setting of a first attribute 
and a low setting of a second attribute versus a low setting 
of the first attribute and a high setting of the second attribute. 

66. The system of claim 65 wherein the conjoint analysis 
engine is adapted to interpret user input with regard to the 35 
second series of screens as a mathematical difference 
between the relative importance of the high setting and the 
low setting for first attribute and the high setting and the low 
setting for the second attribute. 

67. The system of claim 63 wherein the user interface 20 
generator and the conjoint analysis engine comprise appli- 
cation programs adapted for execution on a server computer 
remote from the user. 

68. The system of claim 63 wherein the user interface 
generator and the conjoint analysis engine comprise appli- ^ 
cation programs adapted for execution on a computer local 

to the user. 

69. The system of claim 63 wherein the products or 
services include employer-sponsored health plans. 

70. The system of claim 63 wherein the products or 
services include mutual funds. 

71. The system of claim 63 wherein the products or 
services include consumer goods. 

72. The system of claim 63 wherein the products or 
services include medical services. 

73. The system of claim 63 wherein the products or 35 
services include energy providers. 

74. The system of claim 63 wherein the products or 
services include assisted living facilities. 

75. The system of claim 63 wherein the products or 
services include educational institutions. 40 

76. The system of claim 63 wherein the products or 
services include potential employees or employers, 

77. The system of claim 63 wherein the products or 
services include potential companions available through an 
on-line dating service. 45 

78. The system of claim 63 comprising: 

(a) a presentation layer containing generic functions for 
generating the screens to be presented to the user; 

(b) a data layer containing data relating to the attributes 
and the products or services available to the user; and 50 

(c) a business layer for facilitating communication 
between the data layer and the presentation layer. 

79. The system of claim 78 wherein the conjoint analysis 
engine is implemented in the business layer. 

80. The system of claim 63 wherein the complex alter- 55 
natives include real estate. 

81. The system of claim 80 wherein the user is a pro- 
spective real estate buyer. 

82. The system of claim 63 wherein the products or 
services include combinations of complementary products 60 
or services. 

83. The system of claim 82 wherein the products or 
services include employee benefits. 

84. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 65 
prising: 

using a software-implemented selector tool: 
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(a) presenting a user with a list of attributes relating to 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 

(e) responsive to completion of the conjoint analysis, 
rating the products or services based on the final 
importance values and stored links between the 
attributes and the products or services; and 

(f) responsive to completion of the rating, presenting the 
user with data indicating the relative utility to the user 
of each of the products or services, wherein the prod- 
ucts or services include combinations of complemen- 
tary products or services. 

85. The method of claim 84 wherein the products or 
services include employee benefits other than health plans. 

86. A method for facilitating user selection among com- 
plex alternatives using conjoint analysis, the method com- 
prising: 

using a software-implemented selector tool: 

(a) presenting a user with a list of attributes relating to 
predetermined products or services and requiring the 
user to select among the attributes those which are of 
importance to the user; 

(b) presenting the user with a first series of choices 
requiring the user to input or select first values indi- 
cating the relative importance of a best setting and a 
worst setting for each of the selected attributes; 

(c) presenting the user with a second series of choices 
requiring the user to input or select second values 
indicating the relative importance of the user's prefer- 
ence between first and second pairings of the selected 
attributes, wherein each pairing includes a best setting 
of one attribute and a worst setting of another attribute; 

(d) applying automated conjoint analysis to the first and 
second values, wherein applying automated conjoint 
analysis includes: 

(i) interpreting each of the second values as a math- 
ematical difference between the relative importance 
of a best setting and a worst setting for one attribute 
and a best setting and a worst setting for another 
attribute; and 

(ii) calculating, based on the first values and the math- 
ematical differences, a final importance value for 
each of the attributes; 
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(e) responsive to completion of the conjoint analysis, 
rating the products or services available to the user 
based on the final importance values and stored links 
between the attributes and the products or services; and 

(f) responsive to completion of the rating, providing 
feedback from the conjoint analysis to the user wherein 
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providing feedback includes presenting the user with 
data indicating the relative utility to the user of each of 
the products or services, wherein the products or ser- 
vices include 401(k) plans. 
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